The line of consciousness, as we understand it, is understanding. And as far as what actually constitutes consciousness, we're not even close to understanding. That doesn't mean that LLMs are conscious. It just means we're so far from the real answers to what makes us, it's inconceivable to think we could replicate it.

> Where did we come up with this caricature of AI’s obsessive rationality? “There’s an article I love by [the sci-fi author] Ted Chiang,” Mitchell said, “where he asks: What entity adheres monomaniacally to one single goal that they will pursue at all costs even if doing so uses up all the resources of the world? A big corporation. Their single goal is to increase value for shareholders, and in pursuing that, they can destroy the world. That’s what people are modeling their AI fantasies on.” As Chiang put it in the article in The New Yorker(opens a new tab), “Capitalism is the machine that will do whatever it takes to prevent us from turning it off.”

I didn't realize it til I read it here, but yes, my fear isn't really about the machine, it's about the machine that drives the machine. We already have a class of amoral beings that treat the world as an expendable thing and are willing to burn it down for profit. We should focus on getting rid of that problem first.

Hats off to everyone out there putting in the hours to make the lived experience of these folks much better than they would have otherwise been. If only we had more of you in the world.

Crikey, this isn't sensible, this is completely misanthropic and nihilistic. How can anyone be ok with a machine unilaterally deciding (outside of the courts or any other check mechanism) to murder someone?

I also take issue with the author's postulation that the Defense Production act could be used here. It's one thing to make sheet metal companies build plane parts, but requiring companies to be put themselves "in the loop" so to speak with regards to actual military strategy or defense puts those companies and their employees at unwilling and extraordinary risk. It's basically enlistment. Plus, it can only be used in extraordinary circumstances.

There's actually another possibility here: Anthropic really doesn't care about being in the loop, and are protesting as theater, but behind the scenes, hammering out a deal with the Pentagon, and they'll help under classified status, and none of us will be the wiser.

> I never heard from anyone.

What is the FBI doing if they're not working on cases like this or domestic terrorism/mass shootings? We continue to have both classes of crimes in droves.