https://www.vals.ai/benchmarks/vals_index

You're talking about real data created and curated by humans to help in training LLMs.

It's a trade off between wanting something dumber but fast and cheap, or something slower and more expensive that is vastly more capable and smarter.

Jev's "confidence" scores are just as valid as an LLMs confidence score, i.e. just as likely to be wrong or hallucinated as any LLM.

Ultimately, people are somehow thinking Jev is mysteriously more likely to be right when ultimately it's another non-deterministic magic box except this time with a stricter interface slapped on top of it.

Vaping is equivalent to shooting heroin or doing crack, it's so much more intense and addictive than smoking. I found quitting smoking to be incredibly easy compared to quitting vaping.

Smoking is addictive and was kinda hard to quit. Vaping is insanely, insanely addictive and about 100X as hard to quit (for me anyway). It took me about 3 tries to quit smoking. Its taken me about 100 attempts to quit vaping.

Also, you end up vaping all day and night since there is no reason you can't do it anywhere. In the toilet at work? Vaping. In bed at night, Vaping. Jerking off? Vaping.

It's just insanely bad.

That is, if you force any llm to return json and a confidence it can also do that too and mostly likely it will he better at any one shot classification task than Jev.

LLMs have the great quality of knowing more due to the depth and richness of the training data. If Jev is trying to classify anything outside of its training data, it’s going to do a terrible job.

This for me, isn't interesting, it required no skill, no imagination, in fact it seemed like it happened by dumb luck.

So we have entered an age where an army of know-nothings direct models to old forgotten tasks so they can get 15 minutes of un-deserved attention?

I would say, the only reason it was never solved was because not enough people actually cared about it to begin with.

This isn't a big accomplishment.

Trust me, there are many other people like me in the world and the enterprises are spending even more.

There is more money flowing into the overall AI ecosystem (by far) than the money Nvidia puts in.

The idea that Nvidia is artificially creating the whole demand is laughable and doesn't add up.

The amount of money Nvidia has put into the ecosystem is much, much less than money coming into the ecosystem from actual customers who are willing to pay for the products!

The idea that somehow Nvidia is financing the entire AI industry is laughable. The numbers do not add up at all if you look at the numbers of people paying for Google cloud GPU compute, AWS GPUs, Azure GPUs, Nebius, Coreweave, etc, not even including companies like Fireworks, BaseTen, Together AI, etc .

The reality is this, enterprise companies are spending HUGE amounts of their money on AI products because they are gaining value from them. This money (which doesn't originate from Nvidia) is flowing into the ecosystem. The money being spent by enterprises combined is far, far more than Nvidia puts in.

How much would the average normie pay if Google suddenly charged? Sure the user-base would drop.

And what? Did Google suddenly become a bad business?

I find it funny how people have these strange and hypocritical viewpoints when it comes to OpenAI and Anthropic when the hyperscalars like Google, Amazon etc, followed these exact same kinds of playbooks for years and years.

My old company used it across the board for basically, everything. Engineering flow diagrams, UI prototyping, team retrospectives.

I personally often used it for creating diagrams that I would later insert into slide decks.

It was basically a swiss-army knife type tool which could be applied in so many situations.

Deeply saddened that it's going to Bendingspoons, where companies go to die.

I find it frustrating that people seem to think that someone going from 1M to 1B is somehow different to other numerical operations. It's not. It's 1000 times bigger, it's not a huge deal.

Apple these days has completely lost touch with what people actually want.

I can’t see it being comfortable to hold and type on at all.

I predict the form factor will be gone within two years.

Yes, if you're one of the few world famous sopranos you don't need to teach, but most singers are not world-famous. I knew one singer who toured internationally, had sung in front of thousands of people, had sung with world famous people, etc. But who lived in shared accomodation and worked several other part-time jobs to make ends meet.