That way you can do old school intent matching and rule-based bots that work super well, and only shell out for deeper work.

The world is a very different place than it was in the early 20th century, but at the same time, "those who do not learn from history are doomed to repeat it".

I say this not to be a "doomer". I say this because those forces I mentioned above were very real and we have to keep our eyes wide open.

[1] https://en.wikipedia.org/wiki/Great_Depression

I was trying to avoid naming any products on purpose, but, for example, there is a commercial product that is easy enough for most people and affordable that would work for this- and there are a few open source clones that come close.

The open source clones are not quite polished enough for non-technical users, but they are the closest thing I can think of, basically crossing over a wiki + Markdown for knowledgebase creation with Git-like versioning.

I do think there are some Markdown-based open source projects that might fit the bill.

In fact, if we were to look at the abandoned as an economy of its own, minus the upper income levels, it actually still has a lot of members, and money is a part but does not have to be all of it.

The quiet group to which I refer is a group of people who believe in working together to support each other, and not making a big noise about it. We are finding ways to live working around the current system, and I do think it is gaining support. It takes a mix of support, room/space to experiment and a spirit of partnership first over domination.

FWIW, I'm not anti-capitalist. But I am pro-good life for everyone, and I think the extremes, market failures and inequalities of our current system - well - we can do better.

[1] https://en.wikipedia.org/wiki/Memristor

- Cursor -> SpaceX

- Astral/uv -> OpenAI

- Stainless -> Anthropic

- Bun -> Anthropic

- Astro.js -> Cloudflare

- Deno -> Cloudflare

- VoidZero (Vite, etc.) -> Cloudflare

- NuxtLabs -> Vercel

- Hugging Face -> NVIDIA

- ... what else?

[1] https://github.com/maximhq/bifrost

I don't understand how some of them can be granted to just one company when they are a "global" namespace, and then not allowed by the public to purchase or use.

I'm not talking about ones that are the name of a well known huge company that is unlikely to disappear.

I want them to succeed as a business so I can use their products, but trust does erode over time. I wish they would realize this and value their customer more.

"Normal accidents, or system accidents, are... inevitable in extremely complex systems. Given the characteristic of the system involved, multiple failures that interact with each other will occur, despite efforts to avoid them... while operator error is a very common problem, many failures relate to organizations rather than technology, and major accidents almost always have very small beginnings. Such events appear trivial to begin with before unpredictably cascading through the system to create a large event with severe consequences." [1]

[1] https://en.wikipedia.org/wiki/Normal_Accidents

I don't have formal benchmarks for that, but I can anecdotally say the SIMD work made a measurable improvement in the performance of the calculations vs. just plain Go. I'm very optimistic about how these improvements will help make the Go runtime an even better target for more of these types of work going forward, especially since it is cross-platform.

First they came for all the dev tooling - uv, Cursor, etc. Now the routers and providers - Open Router, Hugging Face...

Who or what is next? And what is the endgame I wonder??

I like to hope that those in positions of power do have a sense of morality though too.. but their worldview is quite different than an ordinary citizen.

I think nondeterminism does not have to be the same as non-coherency - i.e. just because something is randomly sampled does not mean the result has to be incoherent or inconsistent.

Also, if we speak purely about LLM based on how they are implemented now, I feel that is different than speaking about artificial intelligence. The field of AI is much more than just an LLM by itself, and the promise of these companies is not just LLM, whether the underlying models are limited to that technology or not.

FWIW, I have built rule based expert systems, used logic based reasoning systems like NASA CLIPS or rete-algorithm based systems, mathematical/symbolic solvers, written plenty of terrible case/conditional logic in programming languages, worked with ML in its infancy and now worked in AI/LLMs - I give this context only to clarify that I understand what an LLM is and isn't.

With all that said, LLMs have allowed humanity to make advances, at great cost to society (IMHO), and I'd hate to see the opportunity be wasted.

There is plenty of room past "attention is all you need" still to do incredible work, especially at the crossroads between deterministic and nondeterministic behaviors.

We've seen this pattern before several times.. I hope they are listening and address this publicly.

I'm not sure what is going on, some users report it works fine or great, others report the degradation. I've experienced both at times, and it's been such a different experience it has made me wonder if there isn't some sort of hidden A/B test or model router in the background silently downgrading requests at times.

Also, regarding the subsidized access to models, in my opinion, the frontier companies owe it to society to continue it. After mining the public content of all of humanity, I personally feel it is a service they owe the public in return.. not that my feeling of this counts for anything though.