Hacker News: simoiacoshttps://news.ycombinator.com/user?id=simoiacosHacker News RSShttps://hnrss.org/hnrss v2.1.1Sun, 04 Oct 2026 06:10:29 +0000<![CDATA[New comment by simoiacos in "From the creator of Redis; run LLM locally with ds4"]]>Thank you, appreciate it!

]]>Sat, 03 Oct 2026 21:14:16 +0000https://news.ycombinator.com/item?id=49947844simoiacoshttps://news.ycombinator.com/item?id=49947844https://news.ycombinator.com/item?id=49947844<![CDATA[New comment by simoiacos in "From the creator of Redis; run LLM locally with ds4"]]>I just added experimental support for Xe-LPG and Xe-LPG+ in main so you should be able to try it without a patch now.

As I said, I don't have the hardware to test it myself, so let me know how it goes!

]]>Sat, 03 Oct 2026 14:38:03 +0000https://news.ycombinator.com/item?id=49944681simoiacoshttps://news.ycombinator.com/item?id=49944681https://news.ycombinator.com/item?id=49944681<![CDATA[New comment by simoiacos in "From the creator of Redis; run LLM locally with ds4"]]>Please open a PR! I was too conservative with the supported devices.

If your GPU supports XMX we could also explore using it to improve the prefill kernel, but I don't have the hardware to test it myself.

]]>Fri, 02 Oct 2026 23:13:32 +0000https://news.ycombinator.com/item?id=49939732simoiacoshttps://news.ycombinator.com/item?id=49939732https://news.ycombinator.com/item?id=49939732<![CDATA[New comment by simoiacos in "From the creator of Redis; run LLM locally with ds4"]]>He recently said that he finds Rust less ergonomic and that this also affects code written by LLMs, which he thinks excel at writing C partly because of the enormous, high-quality codebase they were trained on. He sees security-critical code as a reason to choose Rust.

The video is in Italian but has an auto-dubbed English audio track: https://www.youtube.com/watch?v=sOt0WpQG5eU\&t=526s

]]>Fri, 02 Oct 2026 22:49:41 +0000https://news.ycombinator.com/item?id=49939565simoiacoshttps://news.ycombinator.com/item?id=49939565https://news.ycombinator.com/item?id=49939565<![CDATA[New comment by simoiacos in "From the creator of Redis; run LLM locally with ds4"]]>Yeah I see the value but I built Xenolith to target smaller models.

I heard antirez saying that he designed DwarfStar also to be forked and tuned to everyone's specific needs. Do you have a specific machine/spec in mind?

]]>Fri, 02 Oct 2026 22:15:28 +0000https://news.ycombinator.com/item?id=49939292simoiacoshttps://news.ycombinator.com/item?id=49939292https://news.ycombinator.com/item?id=49939292<![CDATA[New comment by simoiacos in "From the creator of Redis; run LLM locally with ds4"]]>Nothing comparable but inspired from DwarfStar I wrote a little inference engine for Intel Xe-LP (no XMX) 32GB laptops. The only model supported right now is a quantized Gemma-4, but I don't exclude in the future to support other MoE of similar size. Too bad we have no Qwen 3.8 35B-A3B yet.

I'm also looking into expanding the protocol and the engine to support various steering techniques.

https://github.com/simoneiacomino/xenolith

]]>Fri, 02 Oct 2026 20:15:58 +0000https://news.ycombinator.com/item?id=49938078simoiacoshttps://news.ycombinator.com/item?id=49938078https://news.ycombinator.com/item?id=49938078<![CDATA[New comment by simoiacos in "Ask HN: What are you working on? (January 2026)"]]>Really cute game, nice work!

]]>Sun, 11 Jan 2026 18:35:35 +0000https://news.ycombinator.com/item?id=46578318simoiacoshttps://news.ycombinator.com/item?id=46578318https://news.ycombinator.com/item?id=46578318