Hacker News: tavern1991

New comment by tavern1991 in "What can LLMs never do?"

tavern1991 — Tue, 30 Apr 2024 14:06:18 +0000

To me it seems you can get the LLM to predict some tokens that contain words that point to the right algorithm. But the LLM doesn't know what it chose. It just sees some tokens. Do you think it could somehow tell it had chosen a CNN in its response and then do something with that knowledge to run a CNN?

New comment by tavern1991 in "What can LLMs never do?"

tavern1991 — Tue, 30 Apr 2024 02:00:54 +0000

What do you mean by "choose the right one to solve a problem"? This phrase seems to carry a lot of water for your take. My understanding is that an LLM has no capability to choose anything. It predicting some tokens based on its training data and your prompt.

New comment by tavern1991 in "What can LLMs never do?"

tavern1991 — Tue, 30 Apr 2024 01:54:45 +0000

I couldn't agree more. It is shocking to me how many of my peers think something magic is happening inside an LLM. It is just a token predictor. It doesn't know anything. It can't solve novel problems.