Hacker News: rocketships

New comment by rocketships in "Backprop Alternative: Augmented Lagrangian Predictive Coding"

rocketships — Tue, 15 Sep 2026 08:57:36 +0000

There might be only one paper that's trained on full Imagenet using methods like these.

Training a Predictive Coding Network on ImageNet using Equilibrium Propagation Tugdual Kerjan, Rasmus Høier, Benjamin Scellier https://arxiv.org/abs/2606.03584

It's quite an undertaking.

New comment by rocketships in "Backprop Alternative: Augmented Lagrangian Predictive Coding"

rocketships — Tue, 15 Sep 2026 08:52:25 +0000

This paper uses the "fixed prediction assumption" so I think has caused some confusion (i.e. it's not PC, but PC with a small bandaid). It's a great paper though just the title is misleading somewhat. But all of Beren Millidge's papers are quite good and he was so prolific in the space. Cool to have seen him on the Dwarkesh podcast recently as well.