The pharmaceutical companies are not the ones making clinical decisions - in this case, it's a shared medical decision between a patient and their oncologist.

Having seen how horrific pancreatic cancer is, how difficult it is to treat, and the decades of slow research done by academic scientists to get to this point, I am elated that we have a tool to give patients more time with their families even if their cancer can't be "cured" with this particular drug.

This may seem unsatisfying, but it's real, measurable progress. KRAS has been known about since the earliest days of cancer research, so it's a true breakthrough to finally have a drug targeting it.

I am very skeptical of studies like this that don't adequately reflect real world conditions, but when I was a software engineer I probably wouldn't have understood what "real" medicine is like either.

With that said, just because we don't have a great way of measuring it doesn't mean that we should assume LLMs are intelligent. An LLM is code and a massive collection of training weights. It has no means of observing and reasoning about the world, doesn't store memories the same way that organic brains do (and is in fact quite limited in this aspect). It currently isn't able to solve a problem it hasn't encountered in its training data, or produce novel research on a topic without significant handholding. Furthermore, the frequent errors made by it suggests that it fundamentally does not understand the words that it spits out.

Not really sure what you mean by your anesthesiology comment. Being able to intubate and inject propofol does not make you more of an expert on consciousness than neuroscientists and neurologists.