Hacker News: blints

New comment by blints in "Trump administration is suspending Microsoft from a green card program"

blints — Thu, 08 Oct 2026 15:38:32 +0000

The entire program is a farce. It's the process generating the fraudulent "golly, we just can't find a US citizen for the job" claims, complete with fake ads designed to be undiscoverable.

New comment by blints in "[dead]"

blints — Fri, 11 Sep 2026 17:19:45 +0000

"How dare people I don't like give away software"

New comment by blints in "New Mac Studio with M5 Max and M5 Ultra"

blints — Wed, 26 Aug 2026 19:23:30 +0000

One does not simply "buy a few b200". They come in 8 packs minimally, at >5x that budget.

New comment by blints in "New Mac Studio with M5 Max and M5 Ultra"

blints — Tue, 25 Aug 2026 15:24:18 +0000

I don't know that "consumer hardware" is a useful distinction anymore, it's just "what's your budget and what's your speed requirement".

New comment by blints in "New Mac Studio with M5 Max and M5 Ultra"

blints — Tue, 25 Aug 2026 14:38:01 +0000

It can be more than "slightly", particularly if the model you're interested in (or will be interested in in 6 months) doesn't fit on the mac studio. You also need to account for eg storing 10TB of random checkpoints, load time when experimenting, and so on. When you start actually needing throughput these are all capability gaps in practical use, not just x% benchmark differences.

If you just want to run Qwen 3.8 27B and Deepseek v4 Flash in perpetuity and that's it, there are a lot of solutions that will work and this is a fairly user friendly one.

New comment by blints in "New Mac Studio with M5 Max and M5 Ultra"

blints — Tue, 25 Aug 2026 13:38:36 +0000

The relevant comparison isn't one mac studio to one RTX 6000, it's a 24 channel DDR5 system, which also has ~1.2TB/s of memory bandwidth (or more when Xeon 6 compatible 8800mt/s memory becomes widely available), vastly higher prefill due to more CPU horsepower, orders of magnitude faster networking, can hook into GPU accelerators, can be upgraded etc. A baseline 384GB system from eg Puget is ~30K vs ~12K for the 256GB Mac Studio and you do get value for the money.

New comment by blints in "New Mac Studio with M5 Max and M5 Ultra"

blints — Tue, 25 Aug 2026 13:31:24 +0000

It's unclear to me how bandwidth scales with multiple connections. Many-to-many does not seem ideal. Daisy chaining would be fine for straight pipeline work. There doesn't seem to be an equivalent of a ethernet switch for thunderbolt 5 though.

New comment by blints in "New Mac Studio with M5 Max and M5 Ultra"

blints — Tue, 25 Aug 2026 13:15:10 +0000

It is. That's the mac mini. For local LLMs you would want the Mac Studio, which tops out at 1.2TB/s.

New comment by blints in "New Mac Studio with M5 Max and M5 Ultra"

blints — Tue, 25 Aug 2026 13:13:59 +0000

10 grand for 256GB memory. Likely double that for 512GB, but won't be available or finalized until October. Thunderbolt 5 is highest bandwidth external IO available at 120Gb/s. 1.2TB/s claimed max internal memory bandwidth.

Not exactly "future proof" for >1T parameter models but good for targeting specific lower-parameter models, or if you can rely on pipeline parallelism and run a cluster.

New comment by blints in "Kimi Linear: An Expressive, Efficient Attention Architecture (2025)"

blints — Tue, 28 Jul 2026 15:01:31 +0000

Their claim is even stronger than that, they have complaints about their models being used as a validation step for other model output, which is standard practice in the industry.

New comment by blints in "Department of Commerce has lifted export controls on Claude Fable 5 and Mythos 5"

blints — Wed, 01 Jul 2026 03:01:22 +0000

Most companies do not model themselves as "building on [AI model du jour]" yet. They model themselves as building products with those tools, which they consider as relatively substitutable.