Hacker News: itkovian_

New comment by itkovian_ in "Kimi K3 Architecture Overview and Notes"

itkovian_ — Tue, 28 Jul 2026 20:51:07 +0000

Causal masking allow model to learn implicit positional embeddings. The meme that a transformer block is permutation invariant is not true.

New comment by itkovian_ in "Ask HN: What are the most promising RL fields for a new master student?"

itkovian_ — Sun, 26 Jul 2026 16:38:51 +0000

Intrinsic motivation/curiosity driven exploration/novelty seeking feels like it has a breakthrough paper waiting. If someone could get those methods working for LLMs, we start getting things like move37 but in math proofs and then everything else

New comment by itkovian_ in "Alphabet's cash burn raises alarm for Big Tech as AI spending climbs"

itkovian_ — Thu, 23 Jul 2026 17:19:27 +0000

the difference is all the current capex is going to durable, hard to get physical assets + things like PPAs. In your online shopping analogy, the hyperscalars are acting like Amazon in 1998

New comment by itkovian_ in "Alphabet's cash burn raises alarm for Big Tech as AI spending climbs"

itkovian_ — Thu, 23 Jul 2026 16:02:46 +0000

I just don’t understand this view. This is the most significant technology ever developed. The uncertainty currently is whether it 1) has massive impact, completely altering society and the making world significantly significantly better or 2) if we go into a fast takeoff/rsi loop. Personally I’ve always been highly skeptical of the later, but that seems like a genuine possibility now. It’s not ‘are we going to be able to generate 10% roic on compute’ the answer to that is yes.

New comment by itkovian_ in "GLM 5.2 and the coming AI margin collapse"

itkovian_ — Tue, 07 Jul 2026 02:50:20 +0000

‘640kb of ram should be enough for anyone’

New comment by itkovian_ in "Munich 1991: The Roots of the Current AI Boom"

itkovian_ — Mon, 22 Jun 2026 21:24:31 +0000

Contrarian view; I think he’s right. Many of these ideas it’s almost shocking how many you can find sketched out in his old papers. To the point where I think it’s very wise to read all his work to see what hasn’t showed up yet but likely will. Artificial curiosity for example.

New comment by itkovian_ in "Apertus – Open Foundation Model for Sovereign AI"

itkovian_ — Mon, 22 Jun 2026 00:39:47 +0000

You can’t run a closed llm locally. Strange to frame the dichotomy as between local and open. One begets the other.

New comment by itkovian_ in "GPT-5.5 hallucinates 3x more than MIT-licensed GLM-5.2"

itkovian_ — Sat, 20 Jun 2026 21:25:34 +0000

The entirety of Anthropic believe ai is going to eat everything, not just software, and result in major societal disruption within a year. They do not have a sliver of a doubt on this. Article has no idea, is completely wrong.

New comment by itkovian_ in "Rio de Janeiro's "homegrown" LLM appears to be a merge of an existing model"

itkovian_ — Mon, 15 Jun 2026 04:28:19 +0000

This is called linear mode connectivity and seems to work for almost every large model. So well that in most cases it’s an explicit part of the training process; do many training ‘branches’ then merge then continue.

It is not understood why it works so well.

New comment by itkovian_ in "Open source AI must win"

itkovian_ — Sat, 13 Jun 2026 03:08:15 +0000

Projects like pluralis agora solve this problem. Really what you want is the model to be collectively owned and governed, not local

New comment by itkovian_ in "Statement on US government directive to suspend access to Fable 5 and Mythos 5"

itkovian_ — Sat, 13 Jun 2026 01:14:10 +0000

People forget the people in charge of these companies are some of the smartest people out there full stop. Far more shadowy strategy/things like this going on than people think.

New comment by itkovian_ in "US Government directive to suspend access to Fable 5 and Mythos 5"

itkovian_ — Sat, 13 Jun 2026 01:07:38 +0000

What are the odds this is partially them making the point; you were all complaining about monitoring/access/safeguards: remember we don’t have to give this to you at all. And using a us gov letter as justification for that.

New comment by itkovian_ in "Three of our worst VC stories"

itkovian_ — Fri, 05 Jun 2026 21:37:45 +0000

In many cases the GPs are not, at least nowhere near as much as you’d think. Obviously there are power laws here as well. Non partners, forget about it.

The other thing is it is maybe the most nepotistic industry out there. Which somewhat makes sense given the actual job is so relationship based.

New comment by itkovian_ in "Green card seekers must leave U.S. to apply, Trump administration says"

itkovian_ — Sat, 23 May 2026 22:45:27 +0000

The extreme privilege of being forced to pay a major portion of all income you make, regardless of where you earn it, to the us gov indefinitely. And they make it hard for you to apply to do this. Crazy.

New comment by itkovian_ in "Green card seekers must leave U.S. to apply, Trump administration says"

itkovian_ — Sat, 23 May 2026 20:00:34 +0000

The US isn’t what it used to be. It’s definitely not the best place in the world to live for quality of life, on basically any metric.

The requirement of being permanently obligated to pay us taxes on global income, if you have any kind of global mobility, is not worth it when you look at the situation objectively. The US is the only country that requires this, and signing up is voluntarily.

So while US immigration continues to act as though people will jump through any hoop they put up in order to be granted the extreme privilege of being able to live in the country indefinitely, it’s worth realising it’s not the 70s anymore and thats a goal many people are no longer optimizing for. In fact the opposite - the most talented people I know are all planning their lives to not settle long term in the US.

New comment by itkovian_ in "The sigmoids won't save you"

itkovian_ — Fri, 15 May 2026 17:16:36 +0000

The other thing people don’t understand is exponential curves are self similar. The start of an exponential looks like an exponential. People always look at and think ‘well that’s it it’s exponential now, have missed it, can’t sustain’. Nope.

Good example of this is number of submissions to neurips/icml/iclr. In 2017 that curve was exponential.

New comment by itkovian_ in "Major AI conference flooded with peer reviews written by AI"

itkovian_ — Sat, 29 Nov 2025 17:48:39 +0000

The argument is that there is no incentive to carefully review a paper (I agree), however what used to occur is people would do the right thing without explicit incentives. This has totally disappeared.

New comment by itkovian_ in "Major AI conference flooded with peer reviews written by AI"

itkovian_ — Sat, 29 Nov 2025 17:43:43 +0000

Whether it’s actually 20% or not doesn’t matter, everyone is aware the signal of the top confs is in freefall.

There are also rings of reviewer fraud going on where groups of people in these niche areas all get assigned their own papers and recommend acceptance and in many cases the AC is part of this as well. Am not saying this is common but it is occurring.

It feels as if every layer of society is in maximum extraction mode and this is just a single example. No one is spending time to carefully and deeply review a paper because they care and they feel on principal that’s the right thing to do. People did used to do this.

Node-0-7.5B: A collaborative multi-participant, model-parallel pretrain

itkovian_ — Wed, 17 Sep 2025 00:39:50 +0000

Article URL: https://dashboard.pluralis.ai/

Comments URL: https://news.ycombinator.com/item?id=45270148

Points: 2

# Comments: 0

New comment by itkovian_ in "Stanford to continue legacy admissions and withdraw from Cal Grants"

itkovian_ — Sat, 09 Aug 2025 22:28:29 +0000

These are some of the richest entities - forget about universities - just entities full stop, in the entire country.