Hacker News: ketothekingdom

New comment by ketothekingdom in "You could have invented transformers from memory"

ketothekingdom — Sat, 17 Oct 2026 17:04:58 +0000

Definitely! It's more of an intuition but doesn't explain what vector gets put in the weights and the analysis doesn't involve the learning dynamics at all. I link some papers at the end that do think about how memory relates to the dataset. But the architecture having this storing+lookup property probably is important in helping transformers remember so much information.

New comment by ketothekingdom in "You could have invented transformers from memory"

ketothekingdom — Sat, 17 Oct 2026 03:36:13 +0000

Thank you! It's been sitting in my head for so long. I'm glad I finally got to share it with people

New comment by ketothekingdom in "You could have invented transformers from memory"

ketothekingdom — Sat, 17 Oct 2026 03:35:33 +0000

That's such a neat idea! Now I want to try it out too

New comment by ketothekingdom in "You could have invented transformers from memory"

ketothekingdom — Sat, 17 Oct 2026 00:46:33 +0000

Hey author here! I have a short summary here if people find it helpful: https://x.com/heyyalexwang/status/2111158818730397932?s=46

Put a price on breakthroughs

ketothekingdom — Sat, 10 Oct 2026 02:37:47 +0000

Article URL: https://alexwang.ai/posts/put-a-price-on-breakthroughs/

Comments URL: https://news.ycombinator.com/item?id=50028982

Points: 36

# Comments: 10

The Model Is the Company

ketothekingdom — Fri, 13 Mar 2026 14:40:35 +0000

Article URL: https://alexwang.ai/posts/the-model-is-the-company/

Comments URL: https://news.ycombinator.com/item?id=47365133

Points: 1

# Comments: 0

New comment by ketothekingdom in "Neural audio codecs: how to get audio into LLMs"

ketothekingdom — Wed, 22 Oct 2025 01:31:16 +0000

Cartesia is doing constant time models for audio: https://cartesia.ai/

Test-time regression: a unifying framework for designing sequence models

ketothekingdom — Wed, 22 Jan 2025 16:41:00 +0000

Article URL: https://arxiv.org/abs/2501.12352

Comments URL: https://news.ycombinator.com/item?id=42794658

Points: 1

# Comments: 0