It is broader than that though, and is the distinction I sought to capture with “anyone with access” in my original post. They are connected to the internet, and to a cloud no less! Anyone could be the NSA now, from anywhere in the world. I bet we’ll see these used to collect marketing data too.

Perhaps a limiting principle can be that we simply do not use ALPRs or other surveillance tech, or at least that we don’t connect them to the internet and require a warrant to access and use their data? Personally, I’d just prefer cops enforce traffic law the old fashioned way.

As others have noted, I believe the brightline is less “general purpose computer…” and more “…that is remotely accessible & modifiable effectively anywhere in the world”. I worry not just about OEMs and cops, but also criminals, foreign intelligence agencies, etc. Honestly potentially anyone at this point, now that folks have figured out you can use LLMs to do analysis.

This is a sound foundation for concern by itself, don’t you think?

The Super Bowl commercial that Ring put out about finding lost dogs spooked people for a reason!

You know, I haven’t kept up with MoE and etc where there’s a bit of selection going on, so I should probably be more humble. I think new work has only added different “paths down the same hill” though (no recurrence, just select different matrices), but could be wrong there. I don’t think I’m wrong on my general intuition, just want to be epistemically honest!

Each token prediction is one big function call. Then you just recursively generate more tokens until run out of context or the model predicts a next token indicating end of sequence. Technically the model outputs a matrix where the last row is a probability distribution, but I’m counting sampling from it as part of the chain. Hundreds of billions of dollars has gone into just making the function fatter and gradually changing pieces here and there.

I’d bet making a slack-compatible client or bridge isn’t hard, we all just instinctively know whoever develops it is going to get sued or taken down.

It feels like we quietly gave up on adversarial interoperability awhile ago, and act like we need a whole separate “open walled garden” when what we actually need are legal protections that prevent companies from suing/banning people who call their APIs. Slack, Facebook, etc, are walled gardens only because they can ban/sue people who compete with their client experience.

I figure that will probably never happen in the US (maybe if someone rich starts it), but eventually someone outside of it will make such an adversarial integration and host it from some region that doesn’t care about US laws. Then, when they get away with it, we’ll all praise them as a genius and wonder how Slack could exist at all. The US has many international agreements keeping this illusion alive, but my guess is that even formerly stable markets like Europe could spawn such work if they decide to stop caring about ~1990s-2010s era contempt-of-business-model US laws.

I think both political extremes have their own angles: liberals might be concerned that conservative censors will censor kids from learning about LGBT people and minorities, conservatives will be concerned that liberals will force too much LGBT and minority content onto kids. Or whatever issue, they want to control what your kids read!

This will almost certainly be used to censor adults too, the only reason we aren’t doing that is because it hasn’t been possible to consistently identify people before. Considering who is pushing for this, they’re absolutely going to tie this into advertising, and if they know who you are so do all of the spooky upper echelons who could implement a true censorship regime.

“The only way they can do this is by controlling what you read, shouldn’t that be the parent’s choice?”

Now I’m trying to convince people that identifying adults won’t work either, because kids will still get around it. All the while, we adults live with the negative externality of no longer having anonymous communication. Woe betide us all should this come to pass, but I guess desperate people are how bad things like this tend to happen.