It seems like new age requires a new form of publication instead of sticking to 17th century concept of a "paper".

https://www.bbc.com/future/article/20150721-my-robot-bought-...

If the goal of Xanadu was to offer a better, more principled form of information sharing, they should have focused 99% of effort on the protocols & backend implementation, leaving UI rudimentary. E.g. TUI might be sufficient to browser hypertext, and that would be compatible with ~all systems, unlike their GUI contraptions.

It was demonstrated that LLMs are capable of non-trivial self-introspection. E.g. if a steering vector is injected into residual stream, a sufficiently large LLM might be able to describe what that steering vector represents. A fine-tuned model might be able to describe activations, etc.

If we look at optimization process, it first does a forward pass which produces the output. Then it looks into computations which happened during the forward pass (by that I mean backpropagation), and adjusts parameters in such a way that it might produce a better output.

Formulated this way, it sounds like self-referentiality (system looks into what it just did!), but, of course, implementation is quite simple: it just stores activations from the forward pass. And training process includes not just code which does the forward pass, but also a full description of that computation which allows it to do a backward pass. So it's a kind of an unrolled self-referentiality which is not difficult to implement.

Perhaps more efficient learning can be implemented if researchers figure out a trick to avoid two separate, distinct passes. Our brains don't do a global backprop and are more sample-efficient.

Regarding the power of intelligence, it's generally considered to be synonymous with optimization in the rationalist crowd. It's not about being all geeky and axiomatic, but using all information and tools available for optimization towards outcomes one wants

"Intelligence explosion" was first described by I.J. Good, a mathematician. von Neumann described singularity as a result of accelerating technical progress. He's also a mathematician, not a sci-fi author, although he was a participant in a sci-fi-like plot of secret project building a bomb more powerful than any chemical bomb...

What people don't know is that it was just peppermint oil + glucose. I.e. a mint candy in a pill form.

Perhaps it actually did help people just acting as a placebo / distracting from their panic. "I did something now I should get better".

But a concept of a panic attack was not widely known. I guess doctors believed it's easier to prescribe Validol which "prevents heart attack" than to explain people that their panic attack symptoms are caused by their brain

... Massive Update for Auto-GPT: Code Execution!

Auto-GPT is now able to write it's own code using #gpt4 and execute python scripts!

This allows it to recursively debug, develop and self-improve... ...

Also fun fact: Loveable started as a fairly basic Python script: https://github.com/AntonOsika/gpt-engineer/releases/tag/v0.0...

If you're smart you probably have bigger, more challenging goals, so chances of success aren't higher. Deliberately setting goals lower might not help. Having a mindset which decouples happiness from goals would help, but people are generally not wired for that, evolution wanted us to push harder.