https://news.ycombinator.com/user?id=zander_jiangHacker News RSShttps://hnrss.org/hnrss v2.1.1Sat, 04 Jul 2026 13:45:33 +0000The book is really well written.

]]>Sun, 28 Jun 2026 23:34:11 +0000https://news.ycombinator.com/item?id=48712928zander_jianghttps://news.ycombinator.com/item?id=48712928https://news.ycombinator.com/item?id=48712928I wonder what happens to fireworks ai, who provided the infra to train and serve composer 2, cursor was their largest customer, and they're probably loosing it.

]]>Tue, 16 Jun 2026 19:39:26 +0000https://news.ycombinator.com/item?id=48560793zander_jianghttps://news.ycombinator.com/item?id=48560793https://news.ycombinator.com/item?id=48560793tilert is a highly optimized megakernel, its a single kernel that does the entire decode pass, this enables overlapping weight loading with computation, eliminates cuda launch overhead (CUDA graph does not, contrary to what most people think), allows for more fine-grained pipelining. There're lots of blogs/papers on it. Its currently the best approach to maximize memory bandwidth. But megakernels are incredibly hard to optimize, and only work for small batch sizes (low throughput, hence high price), thats why we don't see them much in production.

]]>Tue, 09 Jun 2026 06:54:39 +0000https://news.ycombinator.com/item?id=48457506zander_jianghttps://news.ycombinator.com/item?id=48457506https://news.ycombinator.com/item?id=48457506tilert is closed source, the repo is just a python wrapper that invokes the binary.

]]>Tue, 09 Jun 2026 06:45:14 +0000https://news.ycombinator.com/item?id=48457438zander_jianghttps://news.ycombinator.com/item?id=48457438https://news.ycombinator.com/item?id=48457438