Hacker News: muricula

New comment by muricula in "DeepSeek V4 Flash 0731"

muricula — Fri, 07 Aug 2026 18:12:34 +0000

Price is confounded by VC subsidies, economies of scale, and inference optimizations. I think a more interesting chart would be ARC AGI vs forwards pass flops or ARC AGI vs training tokens. Of course we don't have those numbers for the closed source models or even some of the open weight ones.

New comment by muricula in "Kimi Linear: An Expressive, Efficient Attention Architecture (2025)"

muricula — Tue, 28 Jul 2026 18:00:46 +0000

I'm no expert but it seems like a descendent of LSTMs. There's a series of papers which show how to reformulate attention as RNNs which arrives at linear attention. Then they add a decay term to get mamba2. Then they add modified the decay term as like a scale to apply both to the existing state and the new update to get delta net. Then they added a gate matrix on the output to get gated delta net. Then Kimi Linear Attention seems to be gated delta net with a more expressive gate. The Gated DeltaNet paper recaptilulates this evolution decently well. But yeah, it feels like they're starting with the same lego blocks and assembling them in similar shapes to accomplish similar but slightly distinct modules.

New comment by muricula in "Parallels confirms MacBook Neo can run Windows in a virtual machine"

muricula — Fri, 13 Mar 2026 18:22:04 +0000

Same Armv8 ISA. And it's the same ISA Android Linux has run on for over a decade.

New comment by muricula in "Irish man detained by ICE for 5 months"

muricula — Mon, 09 Feb 2026 17:22:58 +0000

So you don't care if injustice happens to other people, only if it could happen to you?

New comment by muricula in "OpenBSD-current now runs as guest under Apple Hypervisor"

muricula — Fri, 16 Jan 2026 18:39:34 +0000

The host kernel and probably the host VMM can see guest memory, so I wouldn't use it for that.

New comment by muricula in "Memory Safety"

muricula — Fri, 26 Dec 2025 02:59:51 +0000

Python has that property when you don't bring C extensions into the conversation. Data races exist, but can never cause memory corruption due to the GIL.

New comment by muricula in "Memory Safety"

muricula — Fri, 26 Dec 2025 00:11:49 +0000

Usually people are talking about race conditions. When you say contrived you're thinking races conditions are difficult to win and unrealistic but attackers who have a lot of money on the line spend the time to win all sorts of wild race conditions consistently.

New comment by muricula in "LLM from scratch, part 28 – training a base model from scratch on an RTX 3090"

muricula — Tue, 09 Dec 2025 20:34:58 +0000

I've played with something similar with my M1 using Apple's MLX framework. The problem is I'm compute bound. I've never managed to get my M1 Max's GPU to process more than ~7.8k tokens per second at bf16 precision, so to train a 112M parameter model on ~20 billion tokens I'd need to run the model training for ~30 days.

One solution is to reduce the scope of the problem -- you can train on a smaller less diverse dataset such as TinyStories which is a collection of 1 billion tokens of chatGPT generated children's stories. After about 40 hours, less than one weekend, you'll have a model which can generate mostly grammatical children's stories.

If you have a newer mac and/or an ultra chip you'll have more and faster GPU cores, and might be able to train on FineWeb or a similar, larger and more diverse dataset.

New comment by muricula in "ChkTag: x86 Memory Safety"

muricula — Mon, 20 Oct 2025 20:38:42 +0000

Is there a whitepaper or ISA manual change describing the feature?

New comment by muricula in "Apple A19 SoC die shot"

muricula — Tue, 23 Sep 2025 21:09:20 +0000

Does anyone know what the block dot at 12 o'clock on the image is? https://chipwise.tech/wp-content/uploads/2025/09/A19_SoC_die...

New comment by muricula in "macOS Tahoe Incompatible with Mac Studio M3 Ultra"

muricula — Wed, 17 Sep 2025 23:15:15 +0000

I could be mistaken, but I think the mac studio comes with either an M3 ultra or an M4 max, and the ipad comes with an M4 chip. I think they decided not to make an ultra for the M4 generation, but don't take my word for it.

New comment by muricula in "William Gibson Reads Neuromancer (2004)"

muricula — Tue, 16 Sep 2025 00:21:33 +0000

I think the audio quality gives this recording character. What could be more cyberpunk than hearing the quirky artifacts resulting from ripping an obsolete recording medium?

New comment by muricula in "iOS 18.6.1 0-click RCE POC"

muricula — Tue, 26 Aug 2025 23:26:37 +0000

Look up iMessage's "blastdoor" sandbox: https://support.apple.com/guide/security/blastdoor-for-messa...

New comment by muricula in "Top researchers leave Intel to build startup with 'the biggest, baddest CPU'"

muricula — Fri, 06 Jun 2025 21:55:11 +0000

That might have been true in the early 2000s when they were growing the Hillsborough Oregon campus but most new fabs are opening in Arizona for taxation and political reasons. I don't have the numbers to back it up, but based on articles about Intel layoffs I believe that Intel has been shedding jobs in Oregon for a while now.

This wiki page has a list of Intel fab starts, you can see them being constructed in Oregon until 2013, and after that all new construction moved elsewhere. https://en.wikipedia.org/wiki/List_of_Intel_manufacturing_si...

I can imagine this slow disinvestment in Oregon would only encourage some architects to quit an found a RISC-V startup.

New comment by muricula in "Top researchers leave Intel to build startup with 'the biggest, baddest CPU'"

muricula — Fri, 06 Jun 2025 16:28:37 +0000

The article is written for a different audience than you might be used to. oregonlive is the website for the newspaper The Oregonian, which is the largest newspaper in the state of Oregon. Intel has many of its largest fabs in Oregon and is a big employer there. The local news is writing about a hip new startup for a non-technical audience who know what Intel is and why it's important, but need to be reminded what a CPU actually is.

New comment by muricula in "Apple M3 Ultra"

muricula — Wed, 05 Mar 2025 20:17:30 +0000

Is that a CPU based inference build? Shouldn't you be able to get more performance out of the M3's GPU?

New comment by muricula in "Ask HN: A retrofitted C dialect?"

muricula — Tue, 25 Feb 2025 19:51:23 +0000

You may be interested in the new Clang -fbounds-safety extension https://clang.llvm.org/docs/BoundsSafety.html

New comment by muricula in "TSMC 2nm Process Disclosure – How Does It Measure Up?"

muricula — Tue, 11 Feb 2025 22:32:52 +0000

Tax breaks and politics. https://www.nytimes.com/2023/02/22/technology/arizona-chips-...

New comment by muricula in "U.S. math scores drop on major international test"

muricula — Wed, 11 Dec 2024 00:05:12 +0000

You might double check that the way you number the grades is the same as the way the parent comment numbers them. For example, as I understand it, in the US most kindergarteners are 5 years old and most first graders are 6, while in NZ most first graders are 5 years old and most second graders are six. So to convert from US grades to NZ you add one because in the US kindergarten isn't given a number.

The US has a highly regional system, but as I understand it pre-algebra is taught starting around sixth grade (~11 year olds), which may line up a little closer to your expectations.

New comment by muricula in "Beating the Compiler"

muricula — Fri, 12 Jul 2024 22:44:58 +0000

No dereferences, just casts. It shouldn't generate any loads/reads from memory.