Hacker News: NaiveBayesian

New comment by NaiveBayesian in "Chinese chipmaker shares surge 470%"

NaiveBayesian — Mon, 27 Jul 2026 12:03:54 +0000

Mixture of Experts is already used by pretty much all modern LLMs to address exactly this phenomenon.

Hopefully, future models can be trained to be even more aware of external knowledge, accessible through web search / RAG / whatever it will be then, and might not need to internalize much knowledge at all.

New comment by NaiveBayesian in "A voxel Tokyo in real Japan time – ride the Yamanote line and study Japanese"

NaiveBayesian — Tue, 14 Jul 2026 07:20:11 +0000

Ah I stand corrected. Thanks for pointing that out!

New comment by NaiveBayesian in "A voxel Tokyo in real Japan time – ride the Yamanote line and study Japanese"

NaiveBayesian — Mon, 13 Jul 2026 15:43:58 +0000

For me it showed 400 fps in the top left corner and my laptop fans spun up immediately as well. Seems to render frames continuously rather than waiting for the screen to refresh. Would probably be much less load when limited to 60 fps.

New comment by NaiveBayesian in "Why does kinetic energy increase quadratically, not linearly, with speed? (2011)"

NaiveBayesian — Sat, 27 Jun 2026 07:35:34 +0000

I agree that this feels intuitive, that potential energy should increase linearly with height.

But in the end, it's all up to the units/quantities we choose to measure, no? If we, say, decided to measure "Squenergy" in Sqoules, with 1Sq² = 1J, then suddenly, squenergy does increase linearly with speed! The formula for kinetic Squenergy becomes sqrt(m/2)v.

Of course this complicates other stuff, like potential Squenergy becoming sqrt(MgH), it not being additive, etc.

New comment by NaiveBayesian in "Nextcloud Hub 26 Spring: Built together, designed for the future"

NaiveBayesian — Thu, 11 Jun 2026 17:26:52 +0000

I love nextcloud and have been using it for years. However recently I've considered taking my instance offline or at least behind a VPN because even if only 10% is true of what AI folks are claiming about LLMs finding exploits left and right, it seems super risky to be hosting your private data on nextcloud.

How do you folks deal with these massively increased threats to self-hosted open source apps?

New comment by NaiveBayesian in "AI models collapse when trained on recursively generated data"

NaiveBayesian — Wed, 24 Jul 2024 20:42:57 +0000

Agreed, that's what I struggle to see as well. It's not really clear why the variance couldn't stay the same or go to infinity instead. Perhaps it does follow from some property of the underlying Gamma/Wishart distributions.

New comment by NaiveBayesian in "AI models collapse when trained on recursively generated data"

NaiveBayesian — Wed, 24 Jul 2024 18:10:13 +0000

I believe that counterexample only works in the limit where the sample size goes to infinity. Every finite sample will have μ≠0 almost surely.(Of course μ will still tend to be very close to 0 for large samples, but still slightly off)

So this means the sequence of μₙ will perform a kind of random walk that can stray arbitrarily far from 0 and is almost sure to eventually do so.

New comment by NaiveBayesian in "ERNIE, China's ChatGPT, cracks under pressure"

NaiveBayesian — Thu, 07 Sep 2023 18:18:10 +0000

There was actually a series of language models named after Sesame Street characters back in 2018-2020, starting with ELMo, then BERT, ERNIE (a different model from 2019), Big Bird, ... There are likely some more that I missed.

ELMo: https://arxiv.org/abs/1802.05365 BERT: https://arxiv.org/abs/1810.04805 ERNIE: https://arxiv.org/abs/1904.09223v1 Big Bird: https://arxiv.org/abs/2007.14062

New comment by NaiveBayesian in "Google Maps Testing New Apple Maps-Inspired Map Style"

NaiveBayesian — Fri, 01 Sep 2023 06:47:53 +0000

These calls should be automated in most cases [1]. Still an impressive feat, but there is no way they are paying a large number of people to phone through all businesses in the world.

[1] https://support.google.com/business/answer/7690269?hl=en

New comment by NaiveBayesian in "From Python to Elixir Machine Learning"

NaiveBayesian — Tue, 25 Jul 2023 11:28:36 +0000

If your data loading pipeline grows even slightly complex, then yes, you absolutely need concurrency in order to deliver your samples to the GPU fast enough.

The current workarounds to make this happen in python are quite ugly imho, e.g. Pytorch spawns multiple python processes and then pushes data between the processes through shared memory, which incurs quite some overhead. Tensorflow on the other hand requires you to stick to their Tensor-dsl so that it can run within their graph engine. If native concurrency were a thing, data loading would be much more straightforward to implement without such hacks.