Hacker News: iidsamplehttps://news.ycombinator.com/user?id=iidsampleHacker News RSShttps://hnrss.org/hnrss v2.1.1Tue, 28 Apr 2026 08:28:37 +0000<![CDATA[New comment by iidsample in "An update on recent Claude Code quality reports"]]>We at UT-Austin have done some academic work to handle the same challenge. Will be curious if serving engines could modified. https://arxiv.org/abs/2412.16434 .

The core idea is we can use user-activity at the client to manage KV cache loading and offloading. Happy to chat more!!

]]>Thu, 23 Apr 2026 19:24:41 +0000https://news.ycombinator.com/item?id=47880415iidsamplehttps://news.ycombinator.com/item?id=47880415https://news.ycombinator.com/item?id=47880415