But isn't this like a Jevon's paradox thing, also? If I'm able to become vastly more productive, and that value produces more sellable output for my company, there's no reason to cut anywhere to fund it. This is the same reason a company like Microsoft can hire 80 000 developers, it's because each dev pays for themselves in value (on average). I guess the same can be true for AI spend?

That being said, Anthropic did report being profitable this review quarter (Q2), so it's not as unreasonable as you claim.

Also Google is a pretty major AI company, and they're _insanely_ profitable.

We only know it's a very complicated system with many interlocking dependencies, and based on what we know about complicated systems in general, as well as biology in particular, is that if any one of these unknown dependencies break, the whole system can fail catastrophically.

Therefore the probability that something will go wrong is very high, and the damage could easily be irreparable damage to the species, if not extinction. Does that not give an intolerably high risk?

Whether he's lying is another question, but seems unlikely.

Like it seems horrible not to help the individual, when we have the technology to; but it's also horrible to hurt your species by selfishly propagating faulty genes. And this seems like the kind of problem cultural taboos are good at solving, and I don't really see any other mechanism by which a species can avoid this filter trap.

It's like arguing with someone who doesn't believe in using seat belts when driving. "Why should I put them on?" they say, and when you try to explain what might go wrong they won't listen to any explanation that isn't a hyper-concrete hypothetical. So finally you give in and say, "Well, when we get onto the highway, a truck might lose control and hit us", and their response is "I don't think that's very likely, it seems highly improbable that today we will be hit by a truck when getting on the highway".

I agree with OP that this seems like the kind of thing where the unknown unknowns are so great that the correct approach is serious caution, and that any demand to know exactly how or why it will go wrong, falls in the trap where every specific example is very unlikely to be the thing that goes wrong, but still in total there's like an 80% chance that it goes horribly wrong. I don't know if we have the terminology to talk about this kind of failure mode. "You shouldn't play God" maybe? At least you shouldn't ask for specific examples of how things could go wrong, if you're going to turn around and claim each one highly improbable.

That being said, the scroll was as smooth as regular webpage scrolls. Usually these JS scrolls aren't able to avoid dropping frames or otherwise introducing judder, but this one does appear to run at a consistent and high framerate, which is technically impressive.