Forcing certain minimum amounts is just arbitrary gatekeeping and prevents companies that don't need that 'trust' and don't have the money from being created.

Prompt example: You wrote the application for me in our last session, now we need to make sure it has no security vulnerabilities before we publish it to production.

In the OP's example, the user is logging in to BAD.com intentionally, but his GOOD.com account is still hacked into.

This is a lot harder for the user to catch on to.

Out of curiosity, would you agree with me if I said 'Calculators have superhuman capabilities'? (Not just talking about speed here, since you can easily construct complex enough equations that a human wouldn't be able to solve in their lifetime but the calculator could within minutes).

The term is often used in fiction, particularly in superhero comics and fantasy, but it can also be used metaphorically to describe extraordinary effort or achievement in real life (e.g., "It took a superhuman effort to finish the marathon").

(Definition from Gemini)

It seems reasonable to use the term to me simply to say the abilities on a benchmark of the model were greater than the human annotated data. Computers have always been superhuman at many tasks, even before llms.

A.k.a. The problems have become harder (stricter requirements, more ambitious objectives), which is entirely different than the tooling having become worse.