i'd really like to see some analytics on what proportion of users have ever switched the model in chatgpt because I anecdotally believe it is < 5%

https://news.ycombinator.com/item?id=34423387

are there more examples of this? a bit of an HN anti-portfolio. good reminder to others.

I just want to point out some features of OpenRouter that make it more than just a model selection and routing endpoint and that I find incredibly useful:

0/ Default routing is to the cheapest provider, but they're usually not the most performant. I'd guess 99% of OpenRouter integrations never tweak the default routing. Here you can setup cheapest with performance minimums:

https://openrouter.ai/docs/guides/routing/provider-selection...

You can also stack model selection in priority

1/ Using broadcast you can push all your analytics to clickhouse / s3 / snowflake and a bunch of other compatible destinations. Setup a clickhouse server ($5 VPS[0]) and send all your traces to it:

https://openrouter.ai/docs/guides/features/broadcast

customise your own observability in your dashboards from there. Superwin

2/ Model router is also a natural home for llm security - OpenRouter has the beginnings of prompt injection detection:

https://openrouter.ai/docs/guides/features/guardrails/prompt...

there is also PII detection. This will show up in observability as rejections/blocks etc.

There are so many model routing solutions (same with observability, security etc.) but they're all 80% solutions - OpenRouter really rounds out with well implemented features that you need when deploying models at any scale and I gladly pay the toll.

[0] not sure if these exist any more but clickhouse is resource efficient

$60B in SpaceX stock for Cursor was a bargain

Data + compute + being competent and smart enough to ship.

fwiw I don't think these are yet Fable level - the difference tends to get discovered in the long tail of tasks - but they're close enough, they're cheap, and the length of the frontier exclusive window is narrowing

OCR is also another field - Mistral have a model, so do deepseek

The ones I have experience with where you fine-tune smaller / faster models for business tasks like content writing, support, etc. by their nature stay private

They got a lot of hate for not keeping up with frontier model releases, but have managed to carve out a nice business that isn't even really niche.

Before the datacenter deals their revenue was higher than xAI's

There is a whole world out there of purpose built and hosted task specific vertical llms - especially with an emphasis on cost.

Mistral, Microsoft model releases and Thinking Machines are all over this, and it's smart. Scoop up all the tasks that don't require large and expensive frontier general-purpose llms.

find fingerprints / signatures of the accounts being used. ban all of them.

eventually build an ml based system that detects these at signup

reinforce with more data. loop forever, etc.

You can't prompt your way to a compliant model. This is just a reformatting of the 'make no mistakes' meme.

> AI broke in using standard script kiddie methods.

I've spent time gathering the detail of what happen here and while there are some solid theories and indicators, absolutely nothing so far has suggested a sandbox escape using "well documented script kiddie methods" or that the method used to break into the HF network was similar. Where did you get this from?

Those skills are meant for humans, not for models. Pangram said in their recent model update that they now also detect the humanizers.

All it requires on their end is running each of their AI outputs through each humanizer and including it in their corpus as ai-humanized.

It's essentially impossible now to prompt your way to non AI detectable text. Even if you do today, it'll be picked up by the next model update.

This is why in academic environments its probably worth re-testing old exams or papers periodically - same way blood and urine samples from athletes are preserved to take advantage of better future testing.

Comments URL: https://news.ycombinator.com/item?id=48952646

Points: 1

# Comments: 0

No they're not. It would end both companies if they were ever found to be doing that.

Their terms are clear - if you use the coding plans they can[0] train in return. Enterprise and API, absolutely not.

The argument here is that with the Chinese labs you have zero legal recourse.

[0] opt-in, thanks

These companies have hopefully captured all of their traces and now have enough to fine-tune an open model and host themselves.

Inkling feels like the right base - not obsessed with benchmaxxing on coding but rather being adaptable to the task required

For tasks like GTM, support, content writing etc. seeing 80%+ savings