Hacker News: grungegun

New comment by grungegun in "Neural networks are clean"

grungegun — Thu, 15 Oct 2026 22:06:57 +0000

That's because he's worried about super-intelligence. If LLM's are a normalish tech this is a good step

New comment by grungegun in "The centrality of stupidity in mathematics"

grungegun — Tue, 17 Sep 2024 18:37:10 +0000

In a sense, I spend most of my time on material after quals because it's so much harder to understand.

New comment by grungegun in "Towards 1-bit Machine Learning Models"

grungegun — Fri, 29 Mar 2024 23:33:44 +0000

So there's no performance gain for quantization enabled by the transformer architecture? It seems very strange that quantization works so well since in most of my experiments, the internal model weights of mlps look random.

New comment by grungegun in "Towards 1-bit Machine Learning Models"

grungegun — Fri, 29 Mar 2024 17:38:43 +0000

Does anyone know if this works on vanilla deep networks? These quantization articles always seem to target LLM's which leads me to wonder if there's something special about the LLM architecture vs a vanilla deep architecture.

Ask HN: API for Custom Cards?

grungegun — Tue, 06 Feb 2024 06:58:50 +0000

I'd like to allow customers to submit orders for custom playing cards with both sides printed on. Are there any services that provide an API for this since I don't have printers?

Comments URL: https://news.ycombinator.com/item?id=39271570

Points: 2

# Comments: 0

New comment by grungegun in "Is my toddler a stochastic parrot?"

grungegun — Thu, 16 Nov 2023 17:54:39 +0000

I taught one of my younger brothers a simple sign language when I was younger. His speech was delayed by like 8 months compared to the rest of us. Can't say for sure, but there's a need to emphasize spoken communication with the sign language.

New comment by grungegun in "Mystery math whiz and novelist advance permutation problem"

grungegun — Mon, 05 Jun 2023 15:31:49 +0000

This is somewhat overblown, and only really an issue for some particular theorems and obscure corners of mathematics. And this isn't a recent problem, Hilbert's proof of Nullenschtatz in the early 20th century had logical errors, but is otherwise true.

If a proof is used by 3 people it won't have much scrutiny, but once major results start to be based on the proof, it'll get reviewed more carefully and either accepted or rejected in the long run. The ABC conjecture is probably the biggest example.

New comment by grungegun in "Black holes might be defects in spacetime"

grungegun — Mon, 22 May 2023 18:13:57 +0000

the infinite density is actually after a finite amount of time, since black hole collapse has already happened, which is why it matters that they are predicted to have infinitely dense points at their centers. The key is that this isn't a limit, GR seems to expect that there are infinitely dense objects just floating around breaking space-time.

New comment by grungegun in "DeepFloyd IF: open-source text-to-image model"

grungegun — Fri, 28 Apr 2023 19:37:43 +0000

would be interesting if you could used deepfloyd first for image composition, then apply stable diffusion after for purely stylistic modifications

New comment by grungegun in "DeepFloyd IF: open-source text-to-image model"

grungegun — Fri, 28 Apr 2023 18:12:42 +0000

What does this mean? Isn't the quality of a model determined by how easy it is to get a good picture?

New comment by grungegun in "The Nature of Code (2012)"

grungegun — Tue, 25 Apr 2023 14:32:29 +0000

Loved this book.

When I first started programing, I was convinced that text applications weren't real programs, and the visual aspect of the book pulled me in to be a life-time programmer :)

New comment by grungegun in "Ask HN: DALL-E was trained on watermarked stock images?"

grungegun — Wed, 24 Aug 2022 16:24:34 +0000

For diversity, Dalle 2 has a random chance of injecting "women" or "black" after a prompt. When this happens, at least for me, it generally destroyed the quality of the images. Probably "King" was identified as a gendered word. You can find some discussion of this on the subreddit r/dalle2. Sometimes the images are quite poor, but in this case, openAI is doing additional tampering.

A twitter user figured out which words they were using by generating a lot of images with the starting prompt "A sign being held that says "

New comment by grungegun in "Generating Children’s Stories Using GPT-3 and DALL·E"

grungegun — Wed, 29 Jun 2022 03:59:42 +0000

I'd argue that the incredibly fast rise in quality over the last year alone is what most people are interested in. DALLE and GPT-2 were always able to make heaps of trash. The trajectory of the quality of DALLE-N and GPT-N is what interests me in terms of the AI internet...

New comment by grungegun in "Physicists rewrite the fundamental law that leads to disorder"

grungegun — Thu, 26 May 2022 22:24:42 +0000

yep, that sounds right to me. also I see you're the author of the Noether article from Ars Technica. I enjoyed the read.

New comment by grungegun in "Physicists rewrite the fundamental law that leads to disorder"

grungegun — Thu, 26 May 2022 21:42:17 +0000

Yes, the quantumness of a differential equation is not a property of the differential equation, but a statement about one possible taxonomy of differential equation. Then, whether quantum-type diff eq's have unique properties pertaining to chaos conditioned on our knowledge of them being labelled 'quantum' is an interesting mathematical question.

> Note that there is no Lagrangian for the NS equations, by the way.

I don't know much about fluid dynamics, but I was under the impression that Bennett derives the Lagrangian form in the book Lagrangian Fluid Dynamics

New comment by grungegun in "Physicists rewrite the fundamental law that leads to disorder"

grungegun — Thu, 26 May 2022 20:27:02 +0000

> Differential equations don’t give rise to physical systems.

Sure, but differential equations describe physical systems, and there is a canonical way to derive a quantum differential equation from a classical one by quantifying the classical Lagrangian using the Path Integral formulation. Giving a fairly natural distinction between the types of equations

> Whether any particular DE is a useful model of a particular physical system is a matter for the imagination, and either backed up or refuted by experiment.

This doesn't make sense to me. The Navier-Stokes equations are known to describe the classical behavior of water and are experimentally confirmed to predict things like trajectory. Their effectiveness has nothing to do with my imagination. If I write x=x' for the position vector of atoms in a fluid that will completely fail to describe anything physical.

New comment by grungegun in "Physicists rewrite the fundamental law that leads to disorder"

grungegun — Thu, 26 May 2022 19:47:21 +0000

The differential equations which give rise to physical chaotic systems operate on quantum states interacting with each other at the atomic level, so there has to be a link of some kind.

New comment by grungegun in "Physicists rewrite the fundamental law that leads to disorder"

grungegun — Thu, 26 May 2022 19:45:32 +0000

It looks like in the results section eqs (8)-(13), they give the main thrust of their idea. To demonstrate that not all machines are reversible they have to take the limit of the number of qubits of their machine as n goes to infinity, so their result is still in the limit, same as the typical laws of thermodynamics.

So this is primarily an interesting mathematical restatement at the quantum level. I don't know how useful this is, not having much knowledge about existing quantum information theory/thermodynamics.

New comment by grungegun in "Two-qubit silicon quantum processor with operation fidelity exceeding 99%"

grungegun — Sun, 17 Apr 2022 22:39:07 +0000

Actually, it doesn't increase much faster than linear. It's quasilinear, and so in O(n^(1+\epsilon) for all \epsilon > 0. There are a variety of such results, so most objections don't hold weight.

The paper you linked to names challenges, but it only states those in respect to reaching practical scaling, which is a result of the constant that is associated with the growth rate, but not the growth rate itself.

New comment by grungegun in "Two-qubit silicon quantum processor with operation fidelity exceeding 99%"

grungegun — Fri, 15 Apr 2022 21:11:45 +0000

False, except for a naive implementation, see: https://en.wikipedia.org/wiki/Quantum_threshold_theorem

If you look at the theorem, it is definitely sub-exponential in the number of qubits needed to correct for error.