Interesting discovery.

Not possible. They can chase the models with whack a mole tuning for obvious stuff, but there's always a way to extract what you want from the model.

I don't think it's even a question of distinguishing "moral difference", it just comes down to the "stochastic parrot" behavior that people hate to acknowledge. Yes, at these absurd scales the LLM can maintain impressive levels of coherence, but at the end of the day, spinning up 10000 agents is just running a tree of 10000 prompts in parallel, some of them are just gonna do wacky shit, with the harnesses acting as homeostasis for tasks spiraling into nonsense.

Of course, introducing mods makes Minecraft the most compelling entry in the genre by a huge margin, but not necessarily a fair comparison since the combined human effort involved in the minecraft mod ecosystem vastly eclipses what the NMS team could do on their own.

This is an impressive result, but there is absolutely zero evidence of "the singularity".

We live in a much different world today than during the trust busting era. Extreme concentration is the status quo of today's economy and it's happening across basically every sector and industry.

Lina Khan as the head of the FTC under the most legislatively prolific Democratic president of the last 30 years was completely powerless to break up anything. Even Trump and an army of partisan DAs that were frothing at the mouth to dismantle Trump's enemies have failed to do so.

Just yesterday Google prevailed against the threat of a breakup of their ad businesses which is perhaps the single most compelling example of anticompetitive abuse by big tech besides maybe the Apple ecosystem.

This trend is only going to accelerate as skilled workers age out of the economy and white collar economic activity aggregates into a handful of massive tech companies.

That's all without factoring in that government quid pro quo is now defacto legal and these companies have very deep pockets for donations.

There are many other factors I could mention but the point is that nobody with any power wants to break up these companies.

A more realistic approach is legislation that either forbids providers from suspending or otherwise limiting access to any government integrated system or simply forbidding these types of integrations altogether.