They almost always generate logically correct text, but sometimes that text has a set of incorrect implicit assumptions and decisions that may not be valid for the use case.

Generating a correct correct solution requires proper definition of the problem, which is arguably more challenging than creating the solution.

Basic research would be something like optimal control theory, which came well before the transformer design.

I'm not trying to be evasive; I can see how my distinction could be seen as conveniently just outside industry's purview. Put it this way: I think companies, particularly small ones, are incentivized to pursue well-known methods/materials. Innovation modulates and optimizes.