If people were really looking for exact title search they could write "term".

It is definitely true that youtube's search is optimized for engagement, but going through a separate ui just to search it seems a bit redundant, especially if after I click search I have ti deal with youtube's UI.

Some part of RL training must focus on the length of responses. I would also guess that Anthropic and OpenAI have an incentive to optimize response length without sacrificing user satisfaction/retention.

For example, I would be more satisfied if claude code didn't execute a side-effect free script that produces no output. Embodying the concept of silence is semantically close to predicting the output of an empty program, so it's more efficient to say nothing.

Even in the past though similar tests gave output like says nothing. I think that points more towards optimizing for less tokens than the implied special understanding by the latest models.

I research how people actually use AI products — then make them better. Cognitive science background (MSc), 3+ years on B2B/SaaS at a major tech company. Led the discovery research that took an AI agent from "what if" to production. Ran seven evaluative studies for gen-AI features now serving 100K+ monthly users. Also did a stint as a business analyst in financial services and led an AI data annotation team at a health-tech startup.

Methods: interviews, usability/concept testing, surveys, JTBD, journey mapping, quant in R/Python. Thesis on cognitive biases in LLMs. Looking for a team that uses research to make decisions, not to validate them.

Role: UX Researcher (mixed-methods / product discovery)

Experience: 3+ years

Email: rvbceilx0@mozmail.com

UX researcher with a background in cognition and communication, 3+ years on data- and AI-driven B2B/ERP products. I run mixed-methods studies (interviews, usability tests, concept tests, surveys, diary studies, JTBD, journey mapping, basic telemetry) and turn messy workflows and stakeholder questions into clear, actionable recommendations for product, design, and engineering. I’m mainly looking for interesting, challenging work with teams that are willing to listen to research; I’m flexible on domain and stage.

Willing to relocate: No

Role: UX Researcher (mixed-methods / product discovery)

Experience: 3+ years

Email: rvbceilx0@mozmail.com

UX researcher with a background in cognition and communication, 3+ years on data- and AI-driven B2B/ERP products. I run mixed-methods studies (interviews, usability tests, concept tests, surveys, diary studies, JTBD, journey mapping, basic telemetry) and turn messy workflows and stakeholder questions into clear, actionable recommendations for product, design, and engineering. I’m mainly looking for interesting, challenging work with teams that are willing to listen to research; I’m flexible on domain and stage.

https://sqlscope.netlify.app/

Remote: Yes (Europe timezones)

Willing to relocate: No

Role: UX Researcher (mixed-methods / product discovery)

Experience: 3+ years

Email: rvbceilx0@mozmail.com

UX researcher with a background in cognition and communication, 3+ years on data- and AI-driven B2B/ERP products. I run mixed-methods studies (interviews, usability tests, concept tests, surveys, diary studies, JTBD, journey mapping, basic telemetry) and turn messy workflows and stakeholder questions into clear, actionable recommendations for product, design, and engineering. I’m mainly looking for interesting, challenging work with teams that are willing to listen to research; I’m flexible on domain and stage.

From my experience studying electrical and computer engineering, I definitely prefer that they chose to put hard electrical engineering courses in the first semesters because I knew immediately not to focus on them because I didn't like them.

There needs to be a reward for doing essays. That reward can be emotional eg. "the teacher I respect liked my essay" or "my essay was read in class" or "the teacher gives feedback that makes me feel a sense of growth". In that case, maybe kids will do it.

However, I think it's hard for a teacher to inspire respect to a classroom and the difficulty scales with the number of people in the class, so grades are used as a hack.

Nevertheless the idea of giving money is still good imo, because it also incentivizes the fraud detection becoming more efficient, since mistakes now cost more. Unfortunately I have a feeling people might game that to get more money by triggering false investigations.

The LLM has to read the websites to answer you so that significantly increases the token count, since it has to include them in its input.

The queries for the LLM which were used to estimate costs don't make a lot of sense for LLMs.

You would not ask an LLM to tell you the baggage size for a flight because there might be a rule added a week ago that changes this or the LLM might hallucinate the numbers.

You would ask an LLM with web search included so it can find sources and ground the answer. This applies to any question where you need factual data, otherwise it's like asking a random stranger on the street about things that can cost money.Then the token size balloons because the LLM needs to add entire websites to its context.

If you are not looking for a grounded answer, you might be doing something more creative, like writing a text. In that case, you might be iterating on the text where the entire discussion is sent multiple times as context so you can get the answer. There might be caching/batching etc but still the tokens required grow very fast.

In summary, I think the token estimates are likely quite off. But not to be all critical, I think it was a very informative post and in the end without real world consumption data, it's hard to estimate these things.

I think you're right to complain about the design of the question. It used Google's disadvantage in that it couldn't process visual information to add difficulty to the task.

However I'm pretty sure there's many of these challenges in an average stem subject. An example would be information dense diagrams which describe some chemical process.

I'm genuinely curious to understand how someone manages to understand these without sight. On my side, I can barely visualize so it was always extremely hard to decipher them and even worse remember them.