Anything anyone with a capital-C in their job title says in public should be assumed to be marketing material.

They simply don't do what the label on the box says they do.

I haven't noticed a change in what I trust a model to generate in response to a single prompt in a year. The failure modes are unchanged. Yes, specific failures have improved as they have been documented and passed into model training data, but the way the models fail has not changed. They still fail for me nearly every single day. I'm a pretty heavy user - 3-4 Claude code processes running at a time, all day every day.

What has gotten better is tooling around the model -- but there's no space for exponential growth there. At least, not without exponential cost increase, which would make the whole thing untenable anyway.

Both. They are charging the most they can get away with and that amount is still heavily subsidized by VC capital.

This is like saying first graders should learn to use calculators, not how to do arithmetic.

Some skills are foundational, and must be learned first in order to be able to solve harder problems. Skipping those skills because software can do them is moronic.

That still doesn't guarantee any semantic correspondence between the human readable representation and the model's "thinking".

The child's game of "Opposite Day" is a trivial example of encoding internal thoughts in language in a way that does not correspond to the normal meaning of the language.

You can do this. It's just sticking a different classifier head on top of the model.

Before foundation models it was a standard Deep RL approach. It probably still is within that space (I haven't kept up on the research).

You don't hear about it here because if you do that then every use case needs a custom classifier head which needs to be trained on data for that use case. It negates the "single model you can use for lots of things" benefit of LLMs.

So the point he's trying to make is that Gituhub UI should support Stacked PRs but call them something else because he doesn't like the name?

It's weird.

> Why do we tolerate the fact that GitHub doesn't let you say "approved for changes in `frontend/*`

That's literally what stacked PRs are adding.

I typically generate stacks of 3-5 PRs in 1-2 days now (in a gen-AI world).

If anything, I'd say plants do it more. Everything in the garden is trying to kill everything else.

What used to cost millions per unit now costs tens of thousands. That's significant.

It's like saying artillery isn't that big a deal in 1914. After all, it's been around since 1452.

Name one instance of this actually happening. I'll wait.

It's only surprising to people who still think they're going to build God out of LLMs.