Hacker News: keeeba

New comment by keeeba in "Microsoft and OpenAI end their exclusive and revenue-sharing deal"

keeeba — Mon, 27 Apr 2026 22:15:12 +0000

Not hired Suleyman? Build his own research lab?

Satya made moves early on with OpenAI that should be studied in business classes for all the right reasons.

He also made moves later on that will be studied for all the wrong reasons.

New comment by keeeba in "Statement on the comments from Secretary of War Pete Hegseth"

keeeba — Sat, 28 Feb 2026 10:19:22 +0000

The gap between Anthropic and the other guys keeps growing

New comment by keeeba in "Statement from Dario Amodei on our discussions with the Department of War"

keeeba — Thu, 26 Feb 2026 22:52:18 +0000

Big respect

Total humiliation for Hegseth, sure there will be a backlash

New comment by keeeba in "Learning from context is harder than we thought"

keeeba — Fri, 06 Feb 2026 21:27:02 +0000

To somewhat state the obvious - the problem isn’t the amount of data, it’s the algorithms.

We need to discover the set of learning algorithms nature has, and determine whether they’re implementable in silicon

New comment by keeeba in "The Codex App"

keeeba — Mon, 02 Feb 2026 22:08:50 +0000

Is everything OpenAI do/release now a response to something Anthropic have recently released?

I remember the days when it was worth reading about their latest research/release. Halcyon days indeed.

New comment by keeeba in "Project Genie: Experimenting with infinite, interactive worlds"

keeeba — Fri, 30 Jan 2026 08:19:03 +0000

“ This is one of my fundamental beliefs about the nature of consciousness. We are never able to interact with the physical world directly, we first perceive it and then interpret those perceptions. More often than not, our interpretation ignores and modifies those perceptions, so we really are just living in a world created by our own mental chatter.”

This is an orthodox position in modern philosophy, dating back to at least Locke, strengthened by Kant and Schopenhauer. It’s held up to scrutiny for the past ~400 years.

But really it’s there in Plato too, so 2300+ years. And maybe further back

New comment by keeeba in "Show HN: Use Claude Code to Query 600 GB Indexes over Hacker News, ArXiv, etc."

keeeba — Wed, 31 Dec 2025 10:55:43 +0000

I don’t have the experiments to prove this, but from my experience it’s highly variable between embedding models.

Larger, more capable embedding models are better able to separate the different uses of a given word in the embedding space, smaller models are not.

New comment by keeeba in "GPT-5.2"

keeeba — Thu, 11 Dec 2025 21:07:38 +0000

Doesn’t seem like this will be SOTA in things that really matter, hoping enough people jump to it that Opus has more lenient usage limits for a while

New comment by keeeba in "Python is not a great language for data science"

keeeba — Tue, 25 Nov 2025 22:07:23 +0000

As a fairly extensive user of both Python and R, I net out similarly.

If I want to wrangle, explore, or visualise data I’ll always reach for R.

If I want to build ML/DL models or work with LLM’s I will usually reach for Python.

Often in the same document - nowadays this is very easy with Quarto.

New comment by keeeba in "Claude Opus 4.5"

keeeba — Mon, 24 Nov 2025 19:17:25 +0000

Oh boy, if the benchmarks are this good and Opus feels like it usually does then this is insane.

I’ve always found Opus significantly better than the benchmarks suggested.

LFG

New comment by keeeba in "Venn Diagram for 7 Sets"

keeeba — Fri, 07 Nov 2025 20:55:35 +0000

Please don’t actually use these 5,6,7-way Venn diagrams for anything practical, they’re virtually useless and communicate nothing.

New comment by keeeba in "Generalized K-Means Clustering"

keeeba — Tue, 28 Oct 2025 09:28:36 +0000

I agree it is a profound question. My thesis is fairly boring.

For any given clustering task of interest, there is no single value of K.

Clustering & unsupervised machine learning is as much about creating meaning and structure as it is about discovering or revealing it.

Take the case of biological taxonomy, what K will best segment the animal kingdom?

There is no true value of K. If your answer is for a child, maybe it’ 7 corresponding to what we’re taught in school - mammals, birds, reptiles, amphibians, fish, and invertebrates.

If your answer is for a zoologist, obviously this won’t do.

Every clustering task of interest is like this. And I say of interest because clustering things like digits in the classic MNIST dataset is better posed as a classification problem - the categories are defined analytically.

New comment by keeeba in "Claude Skills"

keeeba — Fri, 17 Oct 2025 04:42:01 +0000

“Skills are a simple concept with a correspondingly simple format.”

From the Anthropic Engineering blog.

I think Skills will be useful in helping regular AI users and non-technical people fall into better patterns.

Many power users of AI were already doing the things it encourages.

New comment by keeeba in "Improved Gemini 2.5 Flash and Flash-Lite"

keeeba — Thu, 25 Sep 2025 17:58:11 +0000

It came from nowhere to 1T tokens per week, seems… suspect.

New comment by keeeba in "Gemma 3 270M re-implemented in pure PyTorch for local tinkering"

keeeba — Wed, 20 Aug 2025 17:12:21 +0000

What use-cases do you see for the 270M’s embeddings, and should we be sticking to token embeddings or can we meaningfully pool for sentence/document embeddings?

Do we need to fine-tune for the embeddings to be meaningful at the sentence/document level?

New comment by keeeba in "Claude Opus 4.1"

keeeba — Tue, 05 Aug 2025 20:26:46 +0000

Anthropic say Opus is better, benchmarks & evals say Opus is better, Opus has more parameters and parameters determine how much a NN can learn.

Maybe Opus just is better

New comment by keeeba in "Software Development at 800 Words per Minute"

keeeba — Mon, 28 Jul 2025 06:49:13 +0000

How have you tested your recall in the long and short term? And what were the results?

New comment by keeeba in "Sam Altman Slams Meta’s AI Talent Poaching: 'Missionaries Will Beat Mercenaries'"

keeeba — Wed, 02 Jul 2025 10:13:01 +0000

Just checking my notes here.

This is the same Sam Altman who abandoned OpenAI’s founding mission in favour of profit?

No it can’t be

New comment by keeeba in "OpenAI and Jony Ive's "io" brand has disappeared"

keeeba — Mon, 23 Jun 2025 09:19:42 +0000

I want to believe that it wasn’t announced at that time, with that name, purely to detract from Google I/O.

But it’s hard

New comment by keeeba in "Claude 4"

keeeba — Fri, 23 May 2025 06:26:26 +0000

https://arxiv.org/abs/2309.08632