Thanks for the recap

For gemma4 26B, same quantization, I get >200TPS.

Also note that qwen is extremely inefficient in reasoning; the reasoning chains are ~3x longer than gemma on average

The best LLM benchmarks test around the margins of those behaviors, tasks that are difficult and correlate with usefulness while being removed enough to stay unpolluted

The local inference space is pretty good nowadays.

Part of it is that it follows the object storage model, and part of it is just to lock people into AWS once they start working with it.

It's better to have a smaller core of highly engaged people than a mass of disengaged eyeballs glazing over.

I remember

It's just sparkling memory safe high performance software

Canada has similar levels of economic development.

It's really not that complicated: controlling for general crime levels, guns drastically increase murder rates.

Cosmic works great for a laptop. But it's a PITA for a desktop. It doesn't deal with multi monitor setups well. There's a recent new bug where the system hardlocks on monitor power state changes, which is unacceptable.

So: great for single screen laptop, not good for desktop or server

Compare the USA to Canada, where you can't bring a gun easily. You'll see Canadian murder rates being very low. Even controlling for similar factors at the city or neighborhood level.

Of course I'm blaming the gun: it's pretty hard to kill someone with other weapons. Stabbings are often survived, even.

That said, my point was that a place like Rio, where you feel alertness at a physiological level by the constant lack of security, still has a murder rate around Houston, a vastly richer and safer city.

And Brazil really is a good comparison in my opinion: the economic inequality is actually worse than in the USA, and they both have the slave holding history leading to concentrated poverty areas with high ethnic segregation

I don't personally think that the upsides of the US gun laws are worth anything near the downsides being paid.

Regarding the police, American police is notoriously prone to violence compared to other developed countries.

Murder is a byproduct of crime. Crime is, largely, downstream of economic conditions with some obvious caveats.

New Hampshire has the 2nd lowest crime rate of the USA states. You could make the same argument for, say, Switzerland (high gun ownership but no crime/murder). But no one would be surprised if you had high gun ownership in Monaco.

Similarly for the ethnic argument you're trying to make: Majority black neighbourhoods in the USA tend to be poor. They also tend to be near more affluent places. Unlike poor white neighbourhoods, which are on average more rural in the USA.

Being poor, and being next to rich people, and being excluded from legal increases of becoming rich, will increase crime.

This should be obvious. Brazil has famously Favelas right next to wealthy areas and has a persistent crime problem for example.

---

In short, it's really incredible how far some Americans will go to deny the obvious truth: *gun prevalence increases deadly crime*.

Sure, some cultural factors will increase crime/violence on the margin. But the reason y'all have a bunch of shootings is that you have a bunch of guns to do shootings with. That simple.

Thanks for the info on the hardware quirks, useful to know!

We seem to be arriving at a cambrian explosion of viable hardware these days between ARM and x86, soldered vs DIMM, etc.

It's refreshing coming from 20 years of x86 being all that matters.

I had to get everything top spec to fit 4 channels of 6000MT/s on my 9950x (asus proArt motherboard and the top tier trident neo RAM sticks) -- otherwise it's reportedly unstable.