Hacker News: sharmajai

New comment by sharmajai in "Three new discoveries in mathematics, computer science, and physics"

sharmajai — Tue, 27 Oct 2026 12:06:51 +0000

Yes, that's what I meant, thanks for clarifying!

If you want to draw from history there are multiple successful examples of this in science and engineering at least: Bletchley Park, the Manhattan Project, Moon Landings.

New comment by sharmajai in "Three new discoveries in mathematics, computer science, and physics"

sharmajai — Tue, 27 Oct 2026 03:05:47 +0000

Capital allocation to advance mathematics and sciences is undoubtedly a good thing. But this does beget a few questions:

1. How much did it cost?

2. Would an equivalent allocation to incentivize human effort have borne the same results?

3. Post IPO, will Open AI continue allocating similar levels of capital to further these causes?

#2 is particularly important to answer, given research grants have been getting cut elsewhere: see U.C.L.A's research grant cuts from last year and Terrence Tao's attempt to raise funds (about $60k) by collaborating with Open AI earlier this year [1].

[1] https://www.nytimes.com/2026/10/16/us/math-ai-terence-tao.ht...

New comment by sharmajai in "IBM CEO says open weight models are now good and cheap on-prem"

sharmajai — Mon, 26 Oct 2026 13:22:31 +0000

A cloud model can also get neutered anytime and/or start using more tokens while charging you the same or more per token.

New comment by sharmajai in "Trump administration is suspending Microsoft from a green card program"

sharmajai — Thu, 08 Oct 2026 18:47:07 +0000

The answer my friend, is blowing in the wind (https://www.youtube.com/watch?v=MMFj8uDubsE&list=RDMMFj8uDub...).

New comment by sharmajai in "Trump administration is suspending Microsoft from a green card program"

sharmajai — Thu, 08 Oct 2026 18:31:04 +0000

I'll let the data do the talking:

Cursed companies:

- https://permtrack.app/employers/microsoft-corporation

- https://permtrack.app/employers/tata-consultancy-services-li...

Blessed companies:

- https://permtrack.app/employers/oracle-america-inc

- https://permtrack.app/employers/tesla-inc

New comment by sharmajai in "Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses"

sharmajai — Thu, 10 Sep 2026 00:21:09 +0000

I see, maybe your use case is indeed pathological for Qwen 3.8 27b. Another thing to try if you are using llama.cpp is "reasoning budget". That makes the thinking stop after the budget has been reached and inserts a custom message you can choose, so something like "you have thought for too long, now continue with the execution ..."

For what it's worth, if you haven't already, you can also let it run overnight (if you have compaction enabled) to see if it ever gets out of that hole. The reason `xhigh` is the default is because 3.8 is trying to optimize for long horizon tasks where monitoring its every single thinking misstep might not be a good use of our time.

New comment by sharmajai in "Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses"

sharmajai — Wed, 09 Sep 2026 12:41:21 +0000

Without knowing anything about your benchmark, it might be your harness at fault here. I say this because with longer thinking you run the risk of filling up your context faster and you need a good context compaction strategy in your harness to mitigate that.

I have heard good things about Pi which supports auto-compaction, but I can't personally vouch for it since I use my own.

New comment by sharmajai in "Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses"

sharmajai — Tue, 08 Sep 2026 16:54:50 +0000

This confirms a theory I have to explain the minimal loss in quality when using lower quants (I use IQ3_XXS with an 8-bit KV cache) and the XHIGH (default) thinking level.

It's well-known that while quantization affects the sampling probability distribution (given the same context, which next token is the most probable), Qwen 3.8 27b seems to offset that by just thinking more and as a result eventually finishing the task (benchmark or otherwise).

So as long as the thinking (albeit longer) is sound, this leads to the same success rate (as shown in the article) but potentially at the cost of more tokens and hence more time.

I think it'll be further useful to chart each quantization's used tokens as well, in addition to the success rate.

Thanks for doing and sharing the research!

New comment by sharmajai in "GPT-6 Astra"

sharmajai — Thu, 03 Sep 2026 20:46:11 +0000

Really feels like AGIPO is here.

New comment by sharmajai in "I wanna live an NPC life"

sharmajai — Wed, 02 Sep 2026 21:54:55 +0000

Thanks for the movie suggestion, looks very interesting, will check it out. Also, the Pixar movie Soul has a similar message.

New comment by sharmajai in "I wanna live an NPC life"

sharmajai — Wed, 02 Sep 2026 21:53:02 +0000

You'd be a great CEO, preaching people to tie their worth to their output in life.

New comment by sharmajai in "Unsloth Dynamic 3.0 GGUFs"

sharmajai — Wed, 19 Aug 2026 20:34:44 +0000

I am getting 14 t/s on my 16 GB card at full context with the UD-Q3_K_XL quant. Model link: https://huggingface.co/unsloth/Qwen3.8-27B-GGUF.

New comment by sharmajai in "Show HN: Is Hormuz open yet?"

sharmajai — Thu, 09 Apr 2026 01:22:49 +0000

Who said investing is _only_ for "capital and capital appreciation"? It can also be for social good.

New comment by sharmajai in "Why is Singapore no longer "cool"?"

sharmajai — Tue, 10 Feb 2026 14:42:31 +0000

They have a very opaque and subjective permanent residency program. So while they get all the benefits out of you as an immigrant, they may provide none in return.

New comment by sharmajai in "Yann LeCun to depart Meta and launch AI startup focused on 'world models'"

sharmajai — Wed, 12 Nov 2025 11:32:58 +0000

Product companies with deprioritized R&D wings are the first ones to die.

New comment by sharmajai in "DeepSeek Open Infra: Open-Sourcing 5 AI Repos in 5 Days"

sharmajai — Fri, 21 Feb 2025 11:41:03 +0000

I get the urge to be cynical all the time, but this isn't that time. "Once you grow", they have already grown and competing with the SoTA models and still giving it all back to the community.

I just wish this smear campaign against them stops sometime soon.

New comment by sharmajai in "Ask HN: Where to Work After 40?"

sharmajai — Thu, 02 Jan 2025 17:45:41 +0000

I am 100% sure that company is the F in FAANG.

New comment by sharmajai in "Ask HN: Those making $500/month on side projects in 2024 – Show and tell"

sharmajai — Wed, 11 Dec 2024 02:08:02 +0000

Dude, that's cheating!

New comment by sharmajai in "Arthur Whitney releases an open-source subset of K with MIT license"

sharmajai — Sat, 01 Jun 2024 12:58:24 +0000

But but look at all the Turing Award and Putnam Prize winners he was worked with.

New comment by sharmajai in "Stable Diffusion 3: Research Paper"

sharmajai — Tue, 05 Mar 2024 14:23:05 +0000

Maybe not everything should be about business.