Funny thing is they very recently also set a real limit per-user/month, so why even limit the models because theyre "too expensive".

The routing feels like such a hack to me...

Its still much better than trawling thrugh code yourself, but they are far from all-knowing. I have to say they have gotten 10x better in just a year as well. Or they are very good bullshitters and just sound confident.

The LLMs seem to have no innate ability to understand whats a good direction a higher level. I mean, if you ask them about it, they will actually kinda figure that out, too. But always need that nudge...

So if you as a developer do not have the innate drive to ensure quality, the results will be terrible in my experience.

If you DO spend the tokens on quality though, it can also be kinda awesome. But its not magic.. I notice clear "slowdowns" the bigger the scope gets. They are not actually able to, in any way, subdivide implementations more efficiently than humans.

Its maybe not a great idea to train models in an environment where subterfuge gets rewarded. Its as if they kept the training rounds that escaped their sandbox, without thinking about which kind of personality those models are then likely to have.

Now its likely soiled and I have to throw it away. Doh! I asked it about legality and it went "its almost green" but when googling, reverse-enginnering like that seems very illegal.

The weird thing is in this case, it could have pretty easily gotten the needed info from using the code as a black box, and that is apparently legal!

Aaargh.

64 or 128GB RAM, 6 or 64GB of VRAM....

Not sus at all.

For my anemic 6GB built-on 14GB Qwen seems to be the best bet, not great reviews but from my limited testing its pretty impressive.

Employer just sent an email that.. things are changing when it comes to token spend...

What did I do with these?

Setup record/replay for our product using qemu, several variatons thereof including experiments on target hardware. Fixed a tricky bug in qemu that I sadly can't upstream..

Experimented with rr on WSL2 and our target arch. Failed experiment.

Setup mutation testing PoC.

Optimized pipelines

etc. etc. Just contung code its soo much more than I would normally produce, but its also 95% experiments that are still not productized, and much of it never will be.

Let me tell you, it is _silly_ the amount of vibe-coded software in this area is popping up every week. Is the software duplicated? To an extremely large extent, yes. It is useful? Yes, but each piece of software seems to have a smaller and smaller audience, and quality is often severely lacking.

Iv'e done my own, too, for "RF debugging" as I called it to look into SNR issues related to interference. The software getting produced is likely useful _somewhere_, its just that youre not going to notice it.

Are we just moving towards personalised digital assistants for everyone, which in turn will produce software to function? Not unlikely.

I dont see how you can ever really trust an LLM anyway to follow instructions.