Hacker News: HelldezNoBanhttps://news.ycombinator.com/user?id=HelldezNoBanHacker News RSShttps://hnrss.org/hnrss v2.1.1Wed, 21 Oct 2026 05:55:35 +0000<![CDATA[Show HN: A layer on top llama.cpp enabling big MoE streaming on phone and laptop]]>Adaptive Streaming Optimizer: Run any Big MoE model on any device, any OS, any HW, local OpenAI-compatible server. Android, Windows, Mac, IOS, Linux. CPU, GPU, NPU (35B on phone 12gb RAM 10 tok/s decode 100-300+ prefill, Windows, Mac even more: 25+ tok/s 16 gb RAM)

Comments URL: https://news.ycombinator.com/item?id=50168132

Points: 1

# Comments: 0

]]>Tue, 20 Oct 2026 15:45:31 +0000https://github.com/Helldez/BigMoeOnEdgeHelldezNoBanhttps://news.ycombinator.com/item?id=50168132https://news.ycombinator.com/item?id=50168132<![CDATA[New comment by HelldezNoBan in "DeepInfer: High-performance, large-scale inference framework for DeepSeek models"]]>Open source is different from open weights

]]>Tue, 20 Oct 2026 12:16:14 +0000https://news.ycombinator.com/item?id=50165193HelldezNoBanhttps://news.ycombinator.com/item?id=50165193https://news.ycombinator.com/item?id=50165193