Hacker News: siris9476https://news.ycombinator.com/user?id=siris9476Hacker News RSShttps://hnrss.org/hnrss v2.1.1Thu, 03 Sep 2026 09:26:23 +0000<![CDATA[Show HN: PulsarForge – run a 744B MoE model on 32GB RAM with zero GPU (pure C)]]>Article URL: https://github.com/siris9476/pulsarforge

Comments URL: https://news.ycombinator.com/item?id=49535090

Points: 4

# Comments: 0

]]>Wed, 02 Sep 2026 12:12:07 +0000https://github.com/siris9476/pulsarforgesiris9476https://news.ycombinator.com/item?id=49535090https://news.ycombinator.com/item?id=49535090<![CDATA[New comment by siris9476 in "Show HN: Running 104GB Qwen3.8-Flash-Next on 48GB Mac with at ~12 tok/s"]]>32GB dedicated to an N-gram table instead of a draft model is an unusual choice for speculative decoding — what made it win over the more common draft-model approach here?

]]>Tue, 01 Sep 2026 21:53:30 +0000https://news.ycombinator.com/item?id=49528769siris9476https://news.ycombinator.com/item?id=49528769https://news.ycombinator.com/item?id=49528769