<rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Hacker News: soraki_soladead</title><link>https://news.ycombinator.com/user?id=soraki_soladead</link><description>Hacker News RSS</description><docs>https://hnrss.org/</docs><generator>hnrss v2.1.1</generator><lastBuildDate>Sat, 29 Aug 2026 11:15:33 +0000</lastBuildDate><atom:link href="https://hnrss.org/user?id=soraki_soladead" rel="self" type="application/rss+xml"></atom:link><item><title><![CDATA[New comment by soraki_soladead in "U.S. sanctions against the A/I Collective"]]></title><description><![CDATA[
<p>except that's not true: <a href="https://en.wikipedia.org/wiki/Patriot_Act" rel="nofollow">https://en.wikipedia.org/wiki/Patriot_Act</a><p>> On October 23, 2001, U.S. representative Jim Sensenbrenner (R-WI) introduced House bill H.R. 3162, which incorporated provisions from a previously-sponsored House bill, and a Senate bill introduced earlier in the month.[5] The next day, October 24, the Act passed the House by a vote of 357–66,[6] with Democrats comprising the overwhelming majority of "no"-votes.<p>> The bill, which removed most of the changes from the Senate version, passed Congress on March 2, 2006, and was signed by President Bush on March 9 and 10 of that year.</p>
]]></description><pubDate>Fri, 28 Aug 2026 21:04:29 +0000</pubDate><link>https://news.ycombinator.com/item?id=49484249</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=49484249</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=49484249</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Is One Layer Enough? A Single Transformer Layer Matches Full-Parameter RL Train"]]></title><description><![CDATA[
<p>The latent representations of the data are like points on a surface. That surface is the manifold. We don't typically have the full manifold and can only sample points from it by embedding data into it.<p>Worth noting a different manifold "exists" after each transformation (e.g. layer). You only sample from the same manifold when you apply the same transformation(s).</p>
]]></description><pubDate>Thu, 02 Jul 2026 14:10:12 +0000</pubDate><link>https://news.ycombinator.com/item?id=48761900</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=48761900</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=48761900</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Is One Layer Enough? A Single Transformer Layer Matches Full-Parameter RL Train"]]></title><description><![CDATA[
<p>I might be misunderstanding your point but this conflates the distinguishing features of each. you mention expansion but autoencoders canonically compress their inputs. autoencoders have an explicit encoder and decoder. most transformers we interact with these days (LLMs) are decoder only. the manifold isn't typically something the model is applied to directly. we apply the function/model to the latent representations. those are what live on the manifold.</p>
]]></description><pubDate>Thu, 02 Jul 2026 13:22:33 +0000</pubDate><link>https://news.ycombinator.com/item?id=48761178</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=48761178</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=48761178</guid></item><item><title><![CDATA[New comment by soraki_soladead in "For first time, a cell built from scratch grows and divides"]]></title><description><![CDATA[
<p>This is awesome! Can someone in this field comment on the implications of sidestepping the cytoskeleton?</p>
]]></description><pubDate>Wed, 01 Jul 2026 15:09:09 +0000</pubDate><link>https://news.ycombinator.com/item?id=48748119</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=48748119</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=48748119</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Show HN: Neural Particle Automata"]]></title><description><![CDATA[
<p>Possibly because SIGGRAPH is coming up and these were papers submitted to that conference.</p>
]]></description><pubDate>Tue, 23 Jun 2026 15:24:09 +0000</pubDate><link>https://news.ycombinator.com/item?id=48646536</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=48646536</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=48646536</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Show HN: High-Res Neural Cellular Automata"]]></title><description><![CDATA[
<p>The original NCA is probably a helpful intro:
<a href="https://distill.pub/2020/growing-ca/" rel="nofollow">https://distill.pub/2020/growing-ca/</a></p>
]]></description><pubDate>Wed, 17 Jun 2026 13:56:41 +0000</pubDate><link>https://news.ycombinator.com/item?id=48570638</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=48570638</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=48570638</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Artificial intelligence is not conscious"]]></title><description><![CDATA[
<p>I think you're misremembering or misunderstanding Picard's argument. It isn't a tangent. Here's the transcript[0].<p>TL;DR Picard's initial arguments are pretty weak, even admitting that Riker as opposing counsel almost had him convinced. During a recess Picard talks to Guinan where she alludes to the future subjugation of many Datas which Picard connects to slavery. Back in the courtroom Picard calls Maddox as a hostile witness and gets him to define sentience--intelligence, self-awareness, consciousness--then walks him into conceding Data meets the first two. Picard's closing boils down to, "we don't know if he meets the third--you can call Data a toaster and rule he is property--_but what if you're wrong_". The judge rules on the basis of erroring on the side of caution due to that uncertainty. It's really a great scene.<p>We're not there yet, obviously. No LLM brings Data's level of awareness but it's as relevant a story as ever because it isn't really about AI but othering for the purpose of subjugation.<p>[0] <a href="http://www.chakoteya.net/NextGen/135.htm" rel="nofollow">http://www.chakoteya.net/NextGen/135.htm</a></p>
]]></description><pubDate>Thu, 04 Jun 2026 00:29:58 +0000</pubDate><link>https://news.ycombinator.com/item?id=48392108</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=48392108</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=48392108</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Colored Shadow Penumbra"]]></title><description><![CDATA[
<p>The post links another that goes into the theory a little:
<a href="https://shahriyarshahrabi.medium.com/in-the-valley-of-gods-style-saturated-shadows-in-blender-lightbake-791113deeba5" rel="nofollow">https://shahriyarshahrabi.medium.com/in-the-valley-of-gods-s...</a><p>Apparently a combination of Mie and Rayleigh scattering.<p>- <a href="https://en.wikipedia.org/wiki/Mie_scattering" rel="nofollow">https://en.wikipedia.org/wiki/Mie_scattering</a><p>- <a href="https://en.wikipedia.org/wiki/Rayleigh_scattering" rel="nofollow">https://en.wikipedia.org/wiki/Rayleigh_scattering</a></p>
]]></description><pubDate>Thu, 07 May 2026 21:10:39 +0000</pubDate><link>https://news.ycombinator.com/item?id=48055079</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=48055079</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=48055079</guid></item><item><title><![CDATA[New comment by soraki_soladead in "NASA Force"]]></title><description><![CDATA[
<p>I'm not saying you're wrong but then why do a big website and branding push. If they had someone in mind they'd bury it on a regular job posting.<p>They specify early to mid career. Imo they're anticipating a ton of applications and bounding it makes reviewing them tractable.</p>
]]></description><pubDate>Fri, 17 Apr 2026 17:21:33 +0000</pubDate><link>https://news.ycombinator.com/item?id=47808303</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=47808303</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=47808303</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Claude Design"]]></title><description><![CDATA[
<p>> There is also no pride.<p>Is the pride not in solving the users' problems?<p>> nobody talks about it, treats it with interest, or pays above market rate to work on it.<p>Definitely needs a citation for this one. For so many products the user isn't paying for standout design. They're paying for insight, leverage, velocity, convenience, whatever. The market definitely supports this by paying above market salaries.<p>Good design can be a useful differentiator but it isn't the only way for a tool or product to "spark joy" and often _fancy_ design (not good design) is used as a crutch for a subpar product.</p>
]]></description><pubDate>Fri, 17 Apr 2026 16:19:03 +0000</pubDate><link>https://news.ycombinator.com/item?id=47807568</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=47807568</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=47807568</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Make tmux pretty and usable (2024)"]]></title><description><![CDATA[
<p>Context: <a href="https://xkcd.com/1053/" rel="nofollow">https://xkcd.com/1053/</a><p>Then, if you're like me and read this years ago, play around with the Light Mode dropdown which was new to me. :)</p>
]]></description><pubDate>Mon, 13 Apr 2026 15:51:55 +0000</pubDate><link>https://news.ycombinator.com/item?id=47753844</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=47753844</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=47753844</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Eternity in six hours: Intergalactic spreading of intelligent life (2013)"]]></title><description><![CDATA[
<p>We don't know however "It would take so long" is an anthropomorphic assumption of time scale.</p>
]]></description><pubDate>Sun, 12 Apr 2026 16:32:01 +0000</pubDate><link>https://news.ycombinator.com/item?id=47741612</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=47741612</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=47741612</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Mystery jump in oil trading ahead of Trump post draws scrutiny"]]></title><description><![CDATA[
<p>Why would we settle for anything less than discontinuing both?</p>
]]></description><pubDate>Tue, 24 Mar 2026 15:43:15 +0000</pubDate><link>https://news.ycombinator.com/item?id=47504354</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=47504354</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=47504354</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Exploring JEPA for real-time speech translation"]]></title><description><![CDATA[
<p>Roughly, when you train a model to make its predictions align to its own predictions in some way, you create a scenario where the simplest "correct" solution is to output a single value under diverse inputs, aka representation collapse. This guarantees that your predicted representations agree, which is technically what you want it to do but it's degenerate.<p>EMA helps because it changes more slowly than the learning network which prevents rapid collapse by forcing the predictions to align to what a historical average would predict. This is a harder and more informative task because the model can't trivially output one value and have it match the EMA target so the model learns more useful representations.<p>EMA has a long history in deep learning (many GANs use it, TD-learning like DQN, many JEPA papers, etc.) so authors often omit defense of it due to over-familiarity or sometimes cargo culting. :)</p>
]]></description><pubDate>Sat, 14 Mar 2026 00:15:42 +0000</pubDate><link>https://news.ycombinator.com/item?id=47371814</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=47371814</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=47371814</guid></item><item><title><![CDATA[New comment by soraki_soladead in "NanoGPT Slowrun: Language Modeling with Limited Data, Infinite Compute"]]></title><description><![CDATA[
<p>also, BabyLM is more of a conference track / workshop than an open-repo competition which creates a different vibe</p>
]]></description><pubDate>Wed, 04 Mar 2026 19:04:20 +0000</pubDate><link>https://news.ycombinator.com/item?id=47252234</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=47252234</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=47252234</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Towards Nyquist Learners"]]></title><description><![CDATA[
<p>Alias-Free GANs? <a href="https://nvlabs.github.io/stylegan3/" rel="nofollow">https://nvlabs.github.io/stylegan3/</a></p>
]]></description><pubDate>Tue, 19 Nov 2024 02:56:53 +0000</pubDate><link>https://news.ycombinator.com/item?id=42179696</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=42179696</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=42179696</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Diffusion for World Modeling"]]></title><description><![CDATA[
<p>We have lossless memory for models today. That's the training data. You could consider this the offline version of a replay buffer which is also typically lossless.<p>The online, continuous and lossy version of this problem is more like how our memory works and still largely unsolved.</p>
]]></description><pubDate>Sun, 13 Oct 2024 15:27:57 +0000</pubDate><link>https://news.ycombinator.com/item?id=41828828</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=41828828</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=41828828</guid></item><item><title><![CDATA[New comment by soraki_soladead in "A most profound video game: a good cognitive aid for research"]]></title><description><![CDATA[
<p>You might enjoy this paper[0] which shows that recurrent position encodings recover grid cell representations and maps to path integration found in a popular model of the hippocampus. This isn't terribly surprising since RNNs have shown this before[1, 2] but its an interesting connection.<p>[0] <a href="https://arxiv.org/abs/2112.04035" rel="nofollow">https://arxiv.org/abs/2112.04035</a><p>[1] <a href="https://arxiv.org/abs/1803.07770" rel="nofollow">https://arxiv.org/abs/1803.07770</a><p>[2] <a href="https://www.nature.com/articles/s41586-018-0102-6" rel="nofollow">https://www.nature.com/articles/s41586-018-0102-6</a></p>
]]></description><pubDate>Sun, 16 Jun 2024 14:12:50 +0000</pubDate><link>https://news.ycombinator.com/item?id=40697226</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=40697226</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=40697226</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Reproducing GPT-2 in llm.c"]]></title><description><![CDATA[
<p>Fwiw, that's SwiGLU in #3 above. Swi = Swish = silu. GLU is gated linear unit; the gate construction you describe.</p>
]]></description><pubDate>Wed, 29 May 2024 04:15:39 +0000</pubDate><link>https://news.ycombinator.com/item?id=40508400</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=40508400</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=40508400</guid></item><item><title><![CDATA[New comment by soraki_soladead in "Building a deep learning rig"]]></title><description><![CDATA[
<p>It's not always about cost. Sometimes the ergonomics of a local machine are nicer.</p>
]]></description><pubDate>Sat, 24 Feb 2024 18:11:50 +0000</pubDate><link>https://news.ycombinator.com/item?id=39493736</link><dc:creator>soraki_soladead</dc:creator><comments>https://news.ycombinator.com/item?id=39493736</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=39493736</guid></item></channel></rss>