Hacker News: itkovian_

New comment by itkovian_ in "Mistral Large 4"

itkovian_ — Tue, 06 Oct 2026 22:38:27 +0000

This is evidenced by the prices on every large-model capable device/node increasing significantly over the last year. Demand is far exceeding supply.

New comment by itkovian_ in "Mistral Large 4"

itkovian_ — Tue, 06 Oct 2026 22:36:42 +0000

Your just missing many things and so have an incorrect picture of the situation - k3 is not on par with fable or astra. Closed models remain far better than best open weights at least today. - compute is not just used for training, more and more is inf - even in training you don’t do one run, you do many. Final run is a small portion of total compute.

The world is extremely compute constrained currently, like extremely.

New comment by itkovian_ in "Verda (Finland) raises $189M in Series B"

itkovian_ — Tue, 22 Sep 2026 20:05:21 +0000

Well I mean Verda is significantly cheaper than the hyperscalars for the exact same device so that’s one thing.

Maybe one argument could be there’s very little value added services required over the raw compute in this new world, and they’re structurally setup to capitalise on that whereas hyperscalars are not.

New comment by itkovian_ in "Show HN: Share your AI Setup, Learn from others"

itkovian_ — Fri, 18 Sep 2026 03:35:14 +0000

I’ve felt for a long time that the things I loved when I first started programming aren’t really there anymore. This comment made me realize that world truly is completely gone.

New comment by itkovian_ in "Anthropic tells investors it will be profitable for second straight quarter"

itkovian_ — Mon, 14 Sep 2026 17:27:10 +0000

I can’t count the number of times I’ve heard variants of ‘they’re losing money on every query’ and ‘I’m getting 10k worth of tokens for $200’ over the last year. People clearly believed serving margins were -ve

New comment by itkovian_ in "We must pace the frontier"

itkovian_ — Sat, 12 Sep 2026 23:34:19 +0000

What are you talking about - I feel like we’re living in parallel realities. If I had to go back to opus 4.5 tomorrow I’d be hugely upset and significantly slowed down

New comment by itkovian_ in "An open letter to Dario: if you mean it, open the weights"

itkovian_ — Sat, 12 Sep 2026 22:40:25 +0000

The author is trying to make the point that there are courses of action available to Dario that would achieve his stated goals but would result in Anthropic having very little impact, control or influence. And that because he’s not doing those things, his motivations extend beyond the stated goals.

It’s a good point and not exactly made subtly but seems completely lost on most comments here.

New comment by itkovian_ in "A practical guide to running 8x RTX PRO 6000's"

itkovian_ — Wed, 02 Sep 2026 21:07:26 +0000

I can’t stand it. Very engineering-y over specified formal language around a complete lack of core understanding. Is damaging other people read this and try to learn things from it.

New comment by itkovian_ in "Kimi K3 Architecture Overview and Notes"

itkovian_ — Tue, 28 Jul 2026 20:51:07 +0000

Causal masking allow model to learn implicit positional embeddings. The meme that a transformer block is permutation invariant is not true.

New comment by itkovian_ in "Ask HN: What are the most promising RL fields for a new master student?"

itkovian_ — Sun, 26 Jul 2026 16:38:51 +0000

Intrinsic motivation/curiosity driven exploration/novelty seeking feels like it has a breakthrough paper waiting. If someone could get those methods working for LLMs, we start getting things like move37 but in math proofs and then everything else

New comment by itkovian_ in "Alphabet's cash burn raises alarm for Big Tech as AI spending climbs"

itkovian_ — Thu, 23 Jul 2026 17:19:27 +0000

the difference is all the current capex is going to durable, hard to get physical assets + things like PPAs. In your online shopping analogy, the hyperscalars are acting like Amazon in 1998

New comment by itkovian_ in "Alphabet's cash burn raises alarm for Big Tech as AI spending climbs"

itkovian_ — Thu, 23 Jul 2026 16:02:46 +0000

I just don’t understand this view. This is the most significant technology ever developed. The uncertainty currently is whether it 1) has massive impact, completely altering society and the making world significantly significantly better or 2) if we go into a fast takeoff/rsi loop. Personally I’ve always been highly skeptical of the later, but that seems like a genuine possibility now. It’s not ‘are we going to be able to generate 10% roic on compute’ the answer to that is yes.

New comment by itkovian_ in "GLM 5.2 and the coming AI margin collapse"

itkovian_ — Tue, 07 Jul 2026 02:50:20 +0000

‘640kb of ram should be enough for anyone’

New comment by itkovian_ in "Munich 1991: The Roots of the Current AI Boom"

itkovian_ — Mon, 22 Jun 2026 21:24:31 +0000

Contrarian view; I think he’s right. Many of these ideas it’s almost shocking how many you can find sketched out in his old papers. To the point where I think it’s very wise to read all his work to see what hasn’t showed up yet but likely will. Artificial curiosity for example.

New comment by itkovian_ in "Apertus – Open Foundation Model for Sovereign AI"

itkovian_ — Mon, 22 Jun 2026 00:39:47 +0000

You can’t run a closed llm locally. Strange to frame the dichotomy as between local and open. One begets the other.

New comment by itkovian_ in "GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2"

itkovian_ — Sat, 20 Jun 2026 21:25:34 +0000

The entirety of Anthropic believe ai is going to eat everything, not just software, and result in major societal disruption within a year. They do not have a sliver of a doubt on this. Article has no idea, is completely wrong.

New comment by itkovian_ in "Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model"

itkovian_ — Mon, 15 Jun 2026 04:28:19 +0000

This is called linear mode connectivity and seems to work for almost every large model. So well that in most cases it’s an explicit part of the training process; do many training ‘branches’ then merge then continue.

It is not understood why it works so well.

New comment by itkovian_ in "Open source AI must win"

itkovian_ — Sat, 13 Jun 2026 03:08:15 +0000

Projects like pluralis agora solve this problem. Really what you want is the model to be collectively owned and governed, not local

New comment by itkovian_ in "Statement on US government directive to suspend access to Fable 5 and Mythos 5"

itkovian_ — Sat, 13 Jun 2026 01:14:10 +0000

People forget the people in charge of these companies are some of the smartest people out there full stop. Far more shadowy strategy/things like this going on than people think.

New comment by itkovian_ in "US Government directive to suspend access to Fable 5 and Mythos 5"

itkovian_ — Sat, 13 Jun 2026 01:07:38 +0000

What are the odds this is partially them making the point; you were all complaining about monitoring/access/safeguards: remember we don’t have to give this to you at all. And using a us gov letter as justification for that.