This is a functional view of consciousness.

Awareness - sentience - follows when the system of processing information is itself part of the information being processed.

Stochastic thoughts relating to this conclusion:

Life is a 'process', it doesn't have a 'physical representation'.

Life is generated entirely from non-living material. "oh my cells are alive", but those cells too when broken down into component parts consist entirely of non-living material. There is no 'special material' to make life out of (okay, carbon, but that's just the local maximum presumed global maximum in efficiency in expressing life) like a chair can be made out of any material (at proper pressures and temperatures) so too can a mind.

The above is true, but also: companies simply are not people, and they should not be supported above the individual, which was the consequences of that decision. Money is not the same as speech. treating it as such creates an aristocracy: something America as a country rebelled against during it's formation.

Intimacy between people in a long distance relationship: that's the killer app.

A lot of people have multiple files for their injected system prompts (a.la openclaw or hermes), I think it would be a good idea to either add or modify this point to be able to handle multiple file injections (system_prompt_append_folder or the like). Fitting that shape would make it easy to compare to those systems and make it easier for people to transition from those systems to yours.

What does it say about us that the sum average of us disgusts us on a visceral artistic level, is that the machine's fault for reflecting us accurately?

It is very possible to have a optimal algorithm that leads to a sub-optimal (local maximum) because the problem is np hard. Both in math and in life.

"It is possible to commit no mistakes and still lose. That is not a weakness. That is life" - Picard

In order for this statement to be true, you must also have perfect knowledge: something that is unachievable in most circumstances. Getting trapped in a local-optimal solution is perfectly possible if you are blindly following stochastic decent along a gradient: as it is too with life... getting trapped like this looks like being in the situation where there is no rational action (only irrational ones) that (eventually) lead to anything other that that status quo. a local optimum is where you have to do increasingly (in proportion to the level of optimization) non-positive actions to escape (likely to another local-optimal).

That's a wild combination of words there.

not OP, but it simply boils down to: The prompt contains no nefarious (arguable, but for this explination, lets go with it being benign) instruction AND the user did not intend to have the model act in an illegal matter.

This "make me a billion dollars" is a maximal example (easy to go wrong). here is the same logic applied to a minimal example (harder to go wrong).

prompt: "make and pour me some tea", agent: goes and kills the grandparent to incinerate them to turn them to ashes to 'make tea'.

Is the human on the hook for the robot acting according to their wishes, but just happened to be aligned so that 'going to the store to buy something' was not within its capabilities, so it works with what it has on hand (the grandparent)?

We either need a much clearer line in the sand, or we need to treat each prompt with the same moral weight. My bet is on the latter.

How many times has that actually happened in real life (opens history book) (oh-no.gif)...

https://www.technologyreview.com/2024/11/27/1107377/a-minecr...

sadly paid-walled (and decently coded) article.

The point is, there appears to be emergent behavior happening: the forming of religion, governance, and social interaction that was not in any system-card. Which makes sense, A brain in a vat with no external stimuli is a boring thing indeed, so too would an LLM be outside of a harness and any input. But put either in a society...

More generally: if having an internal model of how the world works improves next token prediction, then the LLM that contains that would be selected for. For humans, that is the case for our predictions of what would come next (we don't use tokens, of course). We have other studies indicating that there appear to be internal representations of concepts: https://arxiv.org/abs/2305.11169

I really do want to push back on the LLM + harness = chatbot position. A chatbot really is just a served LLM, sure there is code around it that may look like a harness: but unless it loops, streams, or has an interval activation, then it is decidedly not a 'harness'. A harness is defined by having such a loop/stream/interval: regardless of tool-use. Agent means it acts agentically: which requires that loop/stream/interval. Harnesses are what turn chat-bots into (possible) agents.