They would be impressed with our technology even if it has downsides. Wisdom is knowing humans and technology and imperfect tools.

Composer 2.5 was a huge leap with minimal compute from xAI.

They can compete with OpenAI and anthropic with xAI scale compute. They have a top notch model team and incredible training data and huge enterprise costumer contracts.

They’re using more compute, a bigger model and tons of training quality improvements to get more out of an equivalent model.

Much easier to create a vm testing swarm of 100 disitributions with llms

You need some amount of parallel compute and some amount of global comparison.

And the rest is basically a ways to parameters and scale.

(This is in theory, in practice you can get a lot of small % stability and efficiency improvements that really compound in algorithmic details of model architecture)

We won't reuse open source libraries as libraries we import, but as design inspiration for the bespoke tools we make.

It's too cheap to make your own stuff and too expensive to be stuck with someone else primitives.

But grounding AI Coding in existing tools is incredibly powerful.

Pre-training scaling laws all support larger models being more cost effeceint to train then smaller models. And distillation is comparably cheap. So you can get the most juice by training the biggest model you can and distilling it.

Most software engineers will just need cheap tokens.

But things like physics and drug discovery have no foreseeable upper bound.

Most software engineers will just need cheap tokens.

But things like physics and drug discovery have no forseeable upper bound.

Cursor has 1B in enterprise revenue. It doesn't matter if people can clone their product, those deals don't move slowly

Can you not see the significance of that?

And needed a UI to launch and manage swarms for my new swarm library oompa: http://github.com/nbardy/oompa

Cursor has a nice UI, but doesn't let you use your Codex Pro, or Claude Max subscriptions. So I wanted an Open Source solution that wraps the existing harnesses with nice cross client UI

Some core features: - Lets you Search between all Claude Code, Codex, Gemini-Cli, and OpenCode sessions - Open Source, use your IDE to edit your own IDE. long live the dream of emacs, and vim - Lets you launch manage and view swarms of agents on top of a swarm management tool I've been using for a few months - Native markdown and Image Preview inline

Comments URL: https://news.ycombinator.com/item?id=47494318

Points: 2

# Comments: 0

The Trillions of parameters claim is about the pretraining.

It’s most efficient in pre training to train the biggest models possible. You get sample efficiency increase for each parameter increase.

However those models end up very sparse and incredibly distillable.

And it’s way too expensive and slow to serve models that size so they are distilled down a lot.

Also can you run batchwise effectively like vllm on cuda?

Enough to run multiple agents at the same time with throughput?

What actual benefits do they get?

I guess they can have their own models run faster than the competition on their hardware? But they don't even really have anything that consumers use on the ANE as far as I can tell and local LLMs are taking off on macs and could really benefit from this

Or just try to use them. They don’t generalize as well.

They are benchmaxxed.

It’s petulant the way the EU is throwing a hissy fit after we’ve had lop-sided trade deals for years and funding the entire NATO alliance ourselves.

They act like we’re going to war with them when we’re asking for parity and for their self reliance to increase.