https://news.ycombinator.com/user?id=adityas02Hacker News RSShttps://hnrss.org/hnrss v2.1.1Mon, 27 Jul 2026 20:28:38 +0000The individual-shaped-hardware problem gets even sharper at the phone end. Shipping a 3B model on-device, the usable RAM budget after the OS and everything else is more like 2-4GBtotal, not per-model so it's not 'can I afford more VRAM', it's 'can I fit a language model and an STT model and embeddings without the OS killing my process'. Feels like phones are the most hardware-constrained 'individual' tier and get the least airtime in these kind of discussion. Is that because the models that fit are still too limited to be interesting, or something else?

]]>Mon, 27 Jul 2026 09:44:04 +0000https://news.ycombinator.com/item?id=49067188adityas02https://news.ycombinator.com/item?id=49067188https://news.ycombinator.com/item?id=49067188