For example, if you go through some events in your childhood, they may stick with you until your death, as an inevitable part of you. Sure, treatment helps, but probably some memories you can't just erase.

Recycling things into a next generation, with probably better living conditions seems like generally pretty positive thing.

Also, some time you'd probably start to stop learning, not necessarily due to brain aging and neuron death, but simply because of basic architecture of our brain and how information solidifies and it starts to become more difficult to learn new things. We are a little more bored of most things and a lot of mystery and wonder diminishes somewhat.

It's not an insane assumption that the user isn't dumb and has some other reason to be asking the question other than it being a trick/stupid question (duh, if you want to wash your car you need to drive it to the car wash!). Taking it as some ultimate measure of intelligence simply doesn't make sense to me.

In nonhuman animals, even in fierce disputes over territory and mating, killing is rare, because it's quite costly: you eliminate completely a healthy individual, and usually would run the risk of serious injury yourself, making both dying likely. Usually they e.g. resolve mating with displays of beauty/fitness, and territory with displays of force (chimpanzees for example have lots of display of force rituals, specially around selecting leadership, I believe) and sometimes non-lethal conflict (some species evolve apparatus just for this kind of conflict, e.g. antlers, so they can engage in conflict with low chance of injury).

Since we're referring to human cultures, something distinct we have is memory and communication -- information can get out on reputation, behavior, etc. of a group. I think if a group just goes out and murders another in their sleep (which TBF is not so easy), then I imagine for example word would also go out of their actions and may get into trouble with other groups, I'm sure spiritual traditions would also have a say about it, in favor of some sort of "spiritual revenge". But I suppose it's difficult to generalize.

I do think it's interesting to consider some forms of morality, or just metaphysical and logical understanding around ethics, as a kind of technology that enables people to live longer and enable more secure conditions, including preventing large scale conflict that can bring destruction on an industrial scale to entire societies (although misguided moral arguments ironically are also misused sometimes to enact destruction). Although I guess morality alone is not enough (because not everyone seems to internalize it well), and other mechanisms are also helpful to achieve more social stability.

(Also of note is that there can be such thing as too much stability -- for example, for some new more interesting and maybe more worthwhile forms of culture to emerge, old ones have to be replaced, so stability should be balanced with cautious openness to new ideas, technologies, methods, peoples (ethnicity), cultures, ..., and worldviews -- of course, as long as change is in the direction of improving our lives collectively. For example in some cases religious fundamentalism advocates for an absolutist cultural stagnation; we just shouldn't need one group to murder another to spread about new things)

That is, I were under the impression LLMs were just f(context), so chain of thought was f(...f(f(f(initial)+initial)+f(initial)+initial), i.e. y_n+1 = f(y_n+f(y_n-1)), where y_n is the nth output and f() the transformer inference function. Do they carry state across?

So if you want to make a product, there should be readily available, easy to read and follow, guides to make your product compliant. For products with large sales volumes or higher risk, the procedures of course should be more thorough, allowing some more complexity. I think even free consults offered by governments could be a great idea, much better to have consultants before violating a law, than waste money with a lot of inspectors. Also stimulating people to solve problems (many times using technology) is another benefit.

Also, for those small cases, why not put responsibility (for any harm) more directly into both the customers and producers? For example, if a producer of a new low-volume product somehow manages to get a lot of waste packaging into the environment, they could be held responsible and pay a fee, or probably who discarded was the consumer, so the consumer in this case should be held responsible. I get that large corporations should be held to higher standards, and take stronger preemptive measures and follow stricter compliance rules.

I think the same should apply for all sorts of regulations, like electrical safety, radio emissions, etc.. If you're designing and selling a small product, you can and should take responsibility for what happens to it (in the case it is found your device bad design/construction itself caused injury, of course). Maybe the only thing you should be obliged to do was put a large sticker like 'WARNING: Prototype-class device. By opening you accept some RISK OF INJURY from device. Return to source if terms not accepted: (...)' -- that is, both you and the consumer should share some responsibility for trying something experimental.

Probably the overwhelming majority are completely harmless low-voltage devices.

In general, I think outcome-based and performance-oriented regulation is something that should be more widespread. Like, there should be in the worst case two options: (1) You follow a strict set of rules and guidelines that dictate how companies in your industry type should operate (specially important for high-risk stuff like nuclear plants, large civilian housing buildings, etc.); (2) You (instead) take increased resposibility for outcomes of your activity (products, devices, etc.), being liable for any damage at an increased rate.

"Sorry men with guns, the most we can do is send one of those messages."

Back then, if you were a phreaker, you basically got a few free phone calls. And learned a lot about the telephone system. I think for all intents and purposes you were a rounding error and really weren't doing any major harm (i.e. lowering slightly the profit of huge hulking corporations that were quite well). If you were a classic MIT hacker, you never even entertained criminal activities in the first place. I guess the 2600 culture and the Hacker manifesto is more descendant of phreakers and early internet hackers in the "break into computers" sense. But even then, as it says, "their crime was curiosity", and the purpose still was never to steal stuff. That's what criminals do. If you break things as you learn, you have the responsibility for your breakage. If you harm people that can be real harm. There's a difference between unsanitized (and harmless) and plainly an asshole. You gotta learn the difference.

Honestly I think this point is really important to drive today, because if we had script kiddies a few decades ago, today we can have Uber-Script-Kiddies, probably you can get a hold of some jailbroken LLM model and break serious things without technical knowledge or good intentions. Don't do it, kids.

But overall I don't see how it's worthwhile to actually do this kind of hacking today, specially the more attacking kind. I think there is today so many more resources for learning things non-destructively (although I'm sure there always were some).

The hacker mythos in my opinion is due to the mythos that are always built around power. There were the mythos of warriors, of sorcerers, etc., there was the shadowy ninja, and so many others -- they usually wielded some special skill, power or ability. In the case of hackers, they wielded special control and knowledge of computers to do their bidding. I think this kind of myth would happen regardless of intentions -- to break or to defend. It draws our attention and imagination I guess. Kind of like being a magician in an era dominated by communicating machines.

Naturally, the distinction between wielding those powers for good reasons and bad ones would emerge. That's the black hat and grey/white hats. Side note I think the black=bad, white=good association is just a kind of bad one, and nonetheless extremely overused at this point, but I digress. The thing is, what you do have consequences. If the only consequence is you learning stuff, maybe some minor nuisance to a megacorp (like downloading a e-book you don't plan on buying for ), then I think that's the good ole' hacker spirit.

I think the observation and a little bit of daredevil spirit is useful because almost every experiment we do IRL tends to carry at least a little bit of risk. We need to manage this risk wisely. For example, if you're messing with electronics you can run the risk of electrocuting yourself or destroying your device. The right spirit is not don't do it, but learn to do it safely enough, and at an acceptable risk to your device. If you wanted to play with radio transmissions, you run the risk of disrupting communications from emergency services and medical devices. Again, it's not "don't do it", but "know what you're doing". If you're playing with computers, (and you were skilled enough; which most of us (thankfully?) aren't) you can basically unleash a minor disaster. The answer is as always not "don't do it", but "know what you're doing and what you're playing with". Also of course for entrepreneurship as well, it's not "don't do it, never make anything". Everything carries risks. The important thing is to study well enough the risks of what you're doing until you can be reasonably sure (in proportion to the risk) the benefits outweigh the risks. Have integrity. Else yea, don't do it. Don't shove a gazillion ads into my eyeballs until I almost lose my mind, thank you very much.

Hackers are all part of society. That's what Hacking the Planet means in spirit. Use the magic sand to save the world. Wield the beauty of the baud... the mastery of the switch. Or Just learn and have some harmless fun, make someone smile, that might be better than any software or widget you could ever make.

I wonder what it would be like for most cars to be replaced with flying cars (i.e. helicopters). I think the noise alone would be a huge issue. Helicopters can be heard from extremely far away and are quite noisy. If you multiply that by like 1 million in a metropolis, I think that would approach unbearable, specially at nighttime, etc.. Also I don't think noise can be reduced too much, including electric propulsion. Propeller engineering would give you some reduction but still I think too much for near universal usage.

But I think the main thing is just cost. Electric aircraft like that would really be just too expensive for everyone to have em. Not everyone can afford a good old (electric) automobile today.

There's also battery technology needing a significant improvement.

Regulation and infrastructure is comparatively solvable I think.

Take it this way. People seem to judge that LLMs are not conscious and thus have no real inner experience. And that humans do. So if you replaced a human brain with a very powerful LLM (with some simply residual neural matter), you've basically killed the human. He isn't feeling anything at all anymore, he's just an automaton, basically a flesh robot.

I think this story is a weirdly good discussion point because many people still don't seem to "get it" that success is completely fundamentally irrelevant, and what matters is having a good inner life. You are what happens in your mind -- overall good thoughts and inner life = good life; bad thoughts and inner life = bad life. You can theoretically be the richest man in the world and about the most miserable, and very poor and living the best life.

If we don't kill our definition of good life and success (i.e. reaffirming value as pertaining exclusively to the mind), it will sooner or later kill us, or kill what's good in us. The more we can orient our entire society toward good inner lives and not anything else, the better our lives will be.

I still think people underestimate the power of even minor inconvenience. While you can't just click a button to reveal all pseudonyms of someone (e.g. you need to download some obscure tool or even perform statistical analysis yourself), I think this provides significant (and surprising?) protection for pseudonymous individuals, I'd say even (although to a reduced extent) for sophisticated threats like state-level actors. I hope LLMs continue to be unable to do so for the near future (I just tested and LLMs can't do it with a simple prompt).

Which is why I think privacy safeguards still work quite well even while being technically mostly bypassable.

So probably tools like this should be kept private if possible.

But I've come to realize there are serious downsides to letting things run their course too. Some changes are very hard to roll back (famous 'cat's out of the bag') just taking a lot of time to reverse if ever. For example, once there is a long term contractual agreement, if one parties decides to roll back they may just not be able to until the contract expires (like renting land; or worse, selling). A change in software systems for example that need backward compatibility can be quite difficult in technical and nontechnical ways.

I think people need to also keep some sympathy for the protests and let people protest more. I'm leaning more toward: if in doubt, provide visibility to a cause (even if not full support). It's okay to save yourself some energy (in particular for the most important causes). Some things might have to run their course for people to understand they were valuable, and we will probably have to eat some frogs as a consequence. Don't lose you sanity ;) (As the saying goes, "Don't you dare go hollow.")

But yea this glosses over a bit trial-and-error designs and, so to speak, "genetic optimization" kinds of designs where we just try random stuff and say "Hey, this works. Not sure why, but it works.".

It's even quite healthy, I believe, casting into doubt and analyzing all the things we've long taken for granted (this is something the philosopher Russel, among many others, mentions for example). But this exercise can be made somewhat independent of our daily lives and in a good, not excessive, measure.

QIII while solid feels missing lots of flair, it feels more generic shooter. Good, solid, but a little generic.