https://news.ycombinator.com/user?id=grepzeroHacker News RSShttps://hnrss.org/hnrss v2.1.1Thu, 25 Jun 2026 03:00:52 +0000The hard part with these unified wrappers is always the leaky bits: prompt caching, tool-use schemas, structured output, and reasoning tokens differ enough across providers that a common interface tends to quietly drop whatever's provider-specific. How does RubyLLM handle that, escape hatches down to the raw provider, or normalize to a shared subset? Prompt caching is the one I'd care about most, since it's modeled pretty differently between OpenAI and Anthropic and it's where most of my cost savings come from.

]]>Wed, 24 Jun 2026 22:37:02 +0000https://news.ycombinator.com/item?id=48666411grepzerohttps://news.ycombinator.com/item?id=48666411https://news.ycombinator.com/item?id=48666411