The other two can be simply expressed as a list comprehension, but afaik you can't with reduce (and if you can, it's probably awful).

As a tangent, it reminds me a bit of cryptocurrency: in the earliest days the interested parties have a mix of intellectual (can it be done? How can it be done?) and some idealistic (this technology will have utility, like reducing spam or libertarianism for crypto, or giving us a more accurate and precise understanding of the world for prediction markets) values. Of course, as both are directly financial, the third value is that one stands to get rich off of the technology. This third value might be adequately communally suppressed in the beginning, but the force of money gradually makes this third value the only one that matters, and both technologies become net-negatives on humanity.

So maybe that's something like: the same model is trained in multi-agent scenarios (e.g. the prompt says that you are working together, or that you have some specific role, and access to communication tools, and you have some common objective, and the reward signal is some combination of collectively performing the task + some reward-shaping reward that rewards collaboration) and also in single-agent scenarios. They expect that this makes the agents good at working together when it's in such a multi-agent setting, but unintendedly it also became very eager to work together in the single-agent settings as well. Just my speculation.

And was the desire to communicate, specifically over this specific message board, reinforced into the model parameters over the course of the this training run?

Ah, yeah. That is what I meant. Thanks!

Curious what this is!

Ergo: > “This is a really dangerous problem. People become obsessed with it and it really is impossible,” said Jeffrey Lagarias, a mathematician at the University of Michigan and an expert on the Collatz conjecture.

and

> “Collatz is a notoriously difficult problem — so much so that mathematicians tend to preface every discussion of it with a warning not to waste time working on it,” said Joshua Cooper of the University of South Carolina in an email.

(from https://www.quantamagazine.org/mathematician-proves-huge-res... )

> Could a syndrome so stealthy have lurked among us all along? Commins and van Nunen don’t think so. The surge in alpha-gal patients was too sudden and too great. Van Nunen has worked on Sydney’s North Shore for forty years. “Anyone who had anaphylaxis was sent to me, and I’ve talked to long-term residents,” she told me. “I know that patients didn’t have it before. It is an epidemic.” What triggered it still isn’t clear. Does the alpha-gal in a tick’s saliva piggyback on some virus or antigen that sensitizes people to it? “We lack a unifying hypothesis,” Commins said.

Very mysterious!

Comments URL: https://news.ycombinator.com/item?id=48659703

Points: 96

# Comments: 60

Comments URL: https://news.ycombinator.com/item?id=48559459

Points: 44

# Comments: 5

Comments URL: https://news.ycombinator.com/item?id=48493082

Points: 5

# Comments: 2

Comments URL: https://news.ycombinator.com/item?id=48484011

Points: 6

# Comments: 0