https://news.ycombinator.com/user?id=tgw43279wHacker News RSShttps://hnrss.org/hnrss v2.1.1Sat, 25 Apr 2026 12:47:04 +0000Very cool, thanks for sharing! Recovering 96% using just two blocks on IMN-1k, wow!

]]>Tue, 10 Mar 2026 15:24:33 +0000https://news.ycombinator.com/item?id=47324540tgw43279whttps://news.ycombinator.com/item?id=47324540https://news.ycombinator.com/item?id=47324540That was a fun read! The base64 decoding and encoding is quite interesting. A parallel: these models are surprisingly robust to heavy word mangling, back in 2023 people used this trick to jailbreak the models very often, but what was more surprising is that they even understand it. I always thought of it this way there must be some circuitry in the model that maps these almost unrecognizable words/sentences into their rectified versions. But what your base64 also shows is the fact thy can also encode them back as well! (However models are known to not be able to produce mangled output that looks convincingly random. I think the base64 transformation is more mechanical in this regard and hence it‘s easier to do the reverse for them.) So your layer circuit hypothesis aligns pretty well with my mental model of how these models work based on the interpretability work I am familiar with! I really also like the way you used the heatmaps as a tool to derive layer insights, very intuitive! But it’s really surprising that you can simply duplicate layers and achieve better results that generalize! This is some research grade effort! I’m confident you could publish this in NeurIPS or ICML if you put it into a paper! I‘m quite impressed! Great work!

]]>Tue, 10 Mar 2026 14:12:34 +0000https://news.ycombinator.com/item?id=47323520tgw43279whttps://news.ycombinator.com/item?id=47323520https://news.ycombinator.com/item?id=47323520I really like how simple the implementation is!

]]>Sun, 28 Jul 2024 11:24:19 +0000https://news.ycombinator.com/item?id=41092515tgw43279whttps://news.ycombinator.com/item?id=41092515https://news.ycombinator.com/item?id=41092515Regarding your point about a successor to LaTeX: https://typst.app/ is turning out to be great.

]]>Sun, 17 Sep 2023 16:41:36 +0000https://news.ycombinator.com/item?id=37546953tgw43279whttps://news.ycombinator.com/item?id=37546953https://news.ycombinator.com/item?id=37546953