Hacker News: androiddrew

New comment by androiddrew in "OpenAI Prepping for On-Prem Product?"

androiddrew — Thu, 11 Jun 2026 23:07:55 +0000

Hooli box. $$

New comment by androiddrew in "Zig ELF Linker Improvements Devlog"

androiddrew — Sat, 30 May 2026 22:58:28 +0000

I really would like a 1.0, then I think it can actually be adopted by business.

New comment by androiddrew in "Zig: Build System Reworked"

androiddrew — Sat, 30 May 2026 12:06:14 +0000

I think bun is moving to rust because Anthropic owns it and the devs there like rust. So why would they invest in another implementation? Sad to see a good zig example go, but as soon as Anthropic bought it I wrote the project off.

New comment by androiddrew in "Eagle 3.1: Collaboration Between the EAGLE Team, vLLM Team, and TorchSpec Team"

androiddrew — Tue, 26 May 2026 12:25:54 +0000

Are these speculative decoders ok to use for AI coding agents or do they only fit certain workloads?

New comment by androiddrew in "AI-powered hacking has exploded into industrial-scale threat, Google says"

androiddrew — Tue, 12 May 2026 01:41:50 +0000

Initiate regulatory capture. All compute must now reside within a hyper scaler data center for your own protection.

New comment by androiddrew in "SpaceX wants to launch a million satellites"

androiddrew — Sun, 10 May 2026 20:29:31 +0000

Let me fix your title:

SpaceX wants investors to think that they will be able to launch millions of satellites.

New comment by androiddrew in "Meta's embrace of A.I. is making its employees miserable"

androiddrew — Sat, 09 May 2026 20:20:48 +0000

I believe that's the point.

New comment by androiddrew in "Shai-Hulud Themed Malware Found in the PyTorch Lightning AI Training Library"

androiddrew — Thu, 30 Apr 2026 22:09:51 +0000

Another exploit Mythos didn't find. Isn't the god machine kind of failing us?

New comment by androiddrew in "Meta tells staff it will cut 10% of jobs"

androiddrew — Fri, 24 Apr 2026 11:29:14 +0000

Isn't this the same idea of the old Roman decimation.

New comment by androiddrew in "Mozilla Thunderbolt"

androiddrew — Sat, 18 Apr 2026 11:35:13 +0000

Yesterday I actually read the docs on Open WebUI. It’s pretty impressive all the features it supports. I will give thunderbolt a look but I’m seriously considering doubling down on Open WebUI. The only thing I don’t like about their features are that tools and functions can’t be offloaded to external compute, it runs on the same machine.

New comment by androiddrew in "Taking on CUDA with ROCm: 'One Step After Another'"

androiddrew — Tue, 14 Apr 2026 10:41:57 +0000

I’ll try and get in touch with them. Thank you.

New comment by androiddrew in "GAIA – Open-source framework for building AI agents that run on local hardware"

androiddrew — Tue, 14 Apr 2026 00:49:05 +0000

You got it right I think. I’m sitting with two “AI Ready Radeon AI Pro 9700 workstation cards, which are RDNA4 not CDNA. My experience is that my cards are not a priority. Individual engineers at AMD may care, the company doesn’t. I have been trying since February to get ahold of anyone responsible for shipping tuned Tensile gfx1201 kernels in rocm-libs, which is used by Ollama.its been three weeks since I raised enough hell on the discord to get a response, but they still can’t find “who” is responsible for Tensile tuning, and “if” they are even going to do it for the gfx12* cards.

Don’t get me started with vLLM and AITER.

New comment by androiddrew in "GAIA – Open-source framework for building AI agents that run on local hardware"

androiddrew — Tue, 14 Apr 2026 00:00:51 +0000

Yup, meanwhile Jensen is on the Lexfriedman podcast stating the reason why CUDA is successful is because all thier devices run it. The on ramp is at the individual user.

I have and RDNA4 card and they certainly are prioritizing CDNA over a CDNA + RDNA strategy or a unification strategy.

New comment by androiddrew in "Taking on CUDA with ROCm: 'One Step After Another'"

androiddrew — Mon, 13 Apr 2026 12:10:47 +0000

I have been trying since February to get someone at AMD to shipped tuned Tensile kernels in the rcom-libs for the gfx1201. They are used by Ollama but no one on the Developer Discord knows who is responsible for that. It has been pretty frustrating and it shows that AMD has an organizational problem to overcome in addition to all the things technically that they want rocm to do.

New comment by androiddrew in "Will I ever own a zettaflop?"

androiddrew — Fri, 10 Apr 2026 00:06:22 +0000

Not with the price of silicon being what it is

New comment by androiddrew in "Things I Think I Think... Preferring Local OSS LLMs"

androiddrew — Thu, 02 Apr 2026 11:54:02 +0000

I love local first. I am finding that a 120B MoE is hitting the sweet spot for local hosted. Right now that takes a 2K strix halo, a 4k GB10 machine, or a 5k Mac Pro. 2 years from now I think hardware will take us back to the 2k ish range with good performance.

I love my dual GPU setup (2AMD Radeon r9700 64GB vram) but it costs 5x electricity than my GX10 (GB10 chip inside) and since layers are landing in system memory my TPS is half the GX10.

Now a dense model like Devstral2 24B slaps on the Dual GPU setup. I just haven’t gotten as much out of that as I have the 120 MoEs

New comment by androiddrew in "Ollama is now powered by MLX on Apple Silicon in preview"

androiddrew — Tue, 31 Mar 2026 11:14:01 +0000

Get turboquant 4 bit implemented and this would be game changer.

New comment by androiddrew in "The Little Book of C"

androiddrew — Thu, 26 Mar 2026 22:33:51 +0000

Wish they had this for zig

New comment by androiddrew in "Jury finds Meta liable in case over child sexual exploitation on its platforms"

androiddrew — Wed, 25 Mar 2026 10:55:49 +0000

Alternative headline: household spyware cash machine forced to pay $20 for being bad.

If you want to punish Meta then you have to punish the wonder boy who runs it. Not even share holders can fight off the guy spending 80B on the metaverse.

New comment by androiddrew in "Microsoft weighs legal action over $50B Amazon-OpenAI cloud deal"

androiddrew — Wed, 25 Mar 2026 00:10:07 +0000

The poster probably is hoping someone will post the archived version in the comments