Hacker News: yuweiloopy2https://news.ycombinator.com/user?id=yuweiloopy2Hacker News RSShttps://hnrss.org/hnrss v2.1.1Thu, 30 Apr 2026 10:33:41 +0000<![CDATA[New comment by yuweiloopy2 in "Gemma 3 QAT Models: Bringing AI to Consumer GPUs"]]>Been using the 27B QAT model for batch processing 50K+ internal documents. The 128K context is game-changing for our legal review pipeline. Though I wish the token generation was faster - at 20tps it's still too slow for interactive use compared to Claude Opus.

]]>Mon, 21 Apr 2025 13:26:34 +0000https://news.ycombinator.com/item?id=43751784yuweiloopy2https://news.ycombinator.com/item?id=43751784https://news.ycombinator.com/item?id=43751784