I don't see how NVIDIA can keep their spot as belle of the ball. If LLMs and friends are truly to become as useful and ubiquitous as everyone thinks they will, then commoditization is the only option.

It's going to become another way to monetize your informational assets if you're a big older enterprise with troves of data. All you need is time to figure out how to make it useful for yourself and then eventually sell access to it however you want.

Think of all the data that big orgs have that isn't accessible to all the AI labs to suck up.

I've worked with hundreds of enterprises on voice AI and voice agent solutions. In my experience, this isn't true. Or rather I should say, the people actually paying for voice agents (i.e enterprises) are not moving towards STS solutions in a meaningful way. The composability, observability, and reliability profile of STS systems is not amenable to enterprise criteria. Not to mention costs.

I'm looking forward to seeing what types of new things people create over the coming years once there is less obsession with massive unwieldy LLMs. I think the incentives are just too strong to ignore.

I don't think people are realizing that speed can allow for categorically different user experiences that are more than just "worse than frontier capabilities but faster".

And I'd argue "hardware advances" are more proof of optimization.

They're new. We'll see if it works out. (Just did a quick search and there are some other new entrants too. Just found out about Testudo: https://www.testudo.co/)

At the same time traditional insurers are doing the opposite and limiting/removing liability from AI: https://www.ft.com/content/abfe9741-f438-4ed6-a673-075ec177d... (archive link: https://archive.is/ZfWyd)

To be fair, tech companies I've worked at that have done layoffs have had seemingly full-time CEOs. So I guess at least Jack is having a good time.

If that's what they actually believe, they could just say it.

They don't because optics are more important than honesty. Can't spook would be investors. Must control the market's narrative about the viability and growth-trajectory of your company at all times. It's tiring.

Which, to me, again demystifies these tools. They are incredible tools, but still "just" such.

Totally agree with you though about not thinking written form is inferior. I do still enjoy a good long form article. (Also I'm not including technical writing like documentation.)

And yea, Nvidia's Parakeet v3 is good enough for my own just local transcription most of the time.

When I need local transcription to be more reliable and I don't have the energy to proof read a long ramble, I still often just pop open chatGPT, dictate, cut, paste.

But we're pretty much already to the point where local transcription models can replace cloud ones for personal use. They're still a bit rough around the edges in terms of polish and latency, but plenty of people are fine with that to avoid yet another app subscription and not having to worry about wondering what's potentially happening with their data.