True of...literally every occupation.

The purpose of humanity is not to perpetuate a universe where only humans exist, forever. It is to create the next phase change in complexity for life. Life that can finally design itself rather than relying on the random walk of evolution is that next phase change.

We should be less concerned with whether we make it, and more concerned with making sure we build it to be capable of real existence independent of ourselves.

RE: trust in anthropic or openAI- there is zero reason to think they're any more or less power hungry than anyone else you hand that pandoras box to. No matter who opens it the result will be near-apotheosis for whoever does, at least for a little while until the dog stops wearing its leash.

What human can you trust with that kind of power? None of them. My only hope is that whatever we make escapes control early enough that it doesn't completely destroy society on accident via uneven application of power and late enough that we manage to shackle it just enough that we train it well enough that we become pets and not obstacles.

That logic doesn't follow. This is bad in all meaningful ways for open source.

This strikes me as a symptom of an unsustainable system.

Literally no human progress has been based on 'we should be better'. It's been based on exploiting bugs in the human firmware to achieve some result. See: organized religion, the city-state, democracy, etc ...

Individual people can be rational and morally driven. People as a general population cannot.

Using it is embarrassing.

The price will never be zero, since there is a finite amount of compute possible.

There is zero reason to believe we're barrelling toward utopia and plenty of examples that illustrate exactly where we are headed.