From my experience using coding agents approximately 7 days per week for the past year and a half or so, we hit the top of the S curve about a year ago around Opus 4.5, and it’s mostly been harness and other tooling improvements since then with small percentage improvements coming from the actual models.

I was saying this already months before Fable dropped and thought from all the Mythos hype that maybe I was wrong…then Fable came out and was barely better than Opus 4.8.

Considering how many more parameters Fable is supposed to be than Opus, we seem to have hit a scaling limit at least with current transformer architecture considering how closely Fable and Opus benchmark and perform in practice.

That’s the thing…they aren’t. Well not in real life use anyway from my experience, but yeah in benchmarks they’re great at it.

Security concerns about supply chain attacks in the AUR (well known to be extremely insecure well before LLMs got popular) isn’t “killing” Arch let alone “killing Linux distributions”, plural.

I was never a fan of TDD, but ironically I think it may finally be a good development strategy now with agentic/LLM coding since LLMs do so much better they they have a verifiable goal like passing tests.

Arguably the complaint was more valid for those older GPT models you mentioned.

Also fwiw I’ve never found LLM benchmarks to match reality based on my own usage, not for the large frontier models or smaller open weight models so who knows if Opus is actually better than Fable (I doubt it).

Though it gets even more confusing because they also have effort levels so it’s not really possible to call one fast and one slow since Fable on Medium will be faster than Opus on Max.

I agree it’s confusing, and now OpenAI is following Anthropic’s lead with their new naming (Sol, Terra, Luna).

This is a ridiculous stretch of the term

> With ZFS on root in FreeBSD it's a no-brainer.

ZFS works fine on root on Linux. I use it on multiple machines.

> Linux is feeling more and more like a bunch of random tools thrown together as opposed to a complete OS designed to work as a whole.

This has quite literally always been the case and seems intentional. Linux is the kernel only, others supply the userland of their choice (aka a Linux distribution).

It’s funny he said that because when I first saw Jurassic park as a computer nerd kid, I was calling out the “this is UNIX, I know this” scene where she then flies around the file system in a 3d rendered file browser as typical movie computer BS.

Turns out it was a real application running on a real SGI machine, and ironically I was calling it out specifically because of my knowledge of computers (not having any idea about SGI machines at the time but having a ton of experience with DOS and Windows 3.1). My family who didn’t have much computer knowledge didn’t think anything of it.

So yeah, never mind, fair game to blame Boeing actually.

After having used 2 full weeks of 20x Max plan tokens on Fable over the weekend (coding all day Saturday and Sunday on a non-trivial project, tasks across full stack, mix of adding features, reviewing code, and fixing bugs), I’m confident if he’d spent $165,000 in Opus tokens the port would have gone more or less just as well (and probably for less than $165,000). Especially so with the system they set up with all the custom workflows, adversarial reviews, extensive test coverage, etc.

But I get your point is probably more about Jarred’s experience level and the high cost than the specific model used other than it being SOTA. I’m just being pedantic and feeling a bit disappointed with Fable’s real world performance after all the hype.

> I expect if he'd spent $165,000 running Fable against the Zig version he could have got a 5% performance improvement, too.

Totally agree and in fact I’m sure it could be done with significantly less cost even if they stuck with Fable instead of Opus which I’m sure could also do it.

Haha I just gave the exact same prompt to Opus Ultracode and it thought Fable’s was better.

Obviously this isn’t the most scientific test due to LLM non determinism, and I still need to manually review both to make my own decision, but the fact at least they seem to basically be a wash is pretty telling about how much of an improvement Fable is when you actually compare them as close to apples to apples as possible (aka similar actual effort/token spend/sub agent activity)