Hacker News: arilotter

New comment by arilotter in "Rust in the kernel is no longer experimental"

arilotter — Wed, 10 Dec 2025 03:47:43 +0000

This title is moderately clickbait-y and comes with a subtle implication that Rust might be getting removed from the kernel. IMO it should be changed to "Rust in the kernel is no longer experimental"

New comment by arilotter in "Democratizing AI: The Psyche Network Architecture"

arilotter — Wed, 14 May 2025 21:51:29 +0000

Hi - Psyche developer here. Happy to answer any/all questions about the project :)

New comment by arilotter in "Peer-to-peer file transfers in the browser"

arilotter — Wed, 12 Mar 2025 13:46:23 +0000

iroh's stuff is great but their local peer discovery can't work in a browser, since it uses an mdns-like protocol to do it

New comment by arilotter in "Iroh – P2P that just works"

arilotter — Tue, 11 Mar 2025 00:56:43 +0000

big ++ for iroh - using it for a project at work, it's evolving really nicely, has reliable holepunching, and the team is super responsive and happy to dig thru gigs of logs to find a bug :)

New comment by arilotter in "Supreme Court upholds TikTok ban, but Trump might offer lifeline"

arilotter — Fri, 17 Jan 2025 21:51:55 +0000

It's unlikely you can. They're generally only willing to set up corporate deals to sell data in massive bulk. You could buy a domain name, set up a decently real looking website with a corpo looking email, then go to any broker like https://www.acxiom.com/customer-data/ (not affiliated, first one i found on google) and do the whole corporate dance of signing a contract to get what you want.

New comment by arilotter in "Fluid Simulation Pendant"

arilotter — Tue, 14 Jan 2025 00:21:56 +0000

I learned recently that Charlieplexing is kind of like the discrete version of the Radon Transform: https://en.wikipedia.org/wiki/Radon_transform

New comment by arilotter in "Pre-training a 15B parameter language model over the internet"

arilotter — Mon, 02 Dec 2024 19:59:20 +0000

you could absolutely use DisTrO for federated learning. The DeMo optimizer on its own doesn't solve the adverserial aspects of training on local-only data, nor does it solve tensor parallelism across devices, so you're still limited to only what fits on your local GPUs, but it does enable distributed data parallelism over the internet at a bandwidth orders of magnitude lower than before.

New comment by arilotter in "Pre-training a 15B parameter language model over the internet"

arilotter — Mon, 02 Dec 2024 19:57:11 +0000

This specific model is only trained on 100 billion tokens, so it's not SOTA by any means, but we've got designs on larger training runs later :)

New comment by arilotter in "Pre-training a 15B parameter language model over the internet"

arilotter — Mon, 02 Dec 2024 19:56:46 +0000

> Are you planning to eventually do a SETI@home style thing where anyone can join?

That's one of the goals of the stuff we're working on right now, I personally hope we can make it work!

> What was Durk Kingma's involvement in DisTrO?

As a co-author on the paper, we brought him in to bounce some ideas off of & have him validate DeMo's design and implementation to ensure we weren't hallucinating these results.

New comment by arilotter in "Pre-training a 15B parameter language model over the internet"

arilotter — Mon, 02 Dec 2024 18:06:25 +0000

Yo! I'm on the team at Nous that built this tech, happy to answer any questions :)

New comment by arilotter in "DisTrO – a family of low latency distributed optimizers"

arilotter — Wed, 28 Aug 2024 18:19:36 +0000

That's not something that DisTrO solves, but there's plenty of research in that area! See https://arxiv.org/abs/2301.11913 , https://arxiv.org/abs/2206.01288 , https://arxiv.org/abs/2304.11277 etc :)

New comment by arilotter in "DisTrO – a family of low latency distributed optimizers"

arilotter — Wed, 28 Aug 2024 01:45:33 +0000

we're excited to drop the paper & code and let you run the code for yourself to see otherwise !! coming in the next couple months :)

New comment by arilotter in "DisTrO – a family of low latency distributed optimizers"

arilotter — Tue, 27 Aug 2024 21:19:08 +0000

We're excited about the potential and want to find other folks also excited about it that are interested in working for/with us to build things on the foundations of DisTrO! Plus also it's so cool and mind boggling to us that we wanted to share the hype a little bit, it was hard not being able to tell anyone we were working on it

New comment by arilotter in "DisTrO – a family of low latency distributed optimizers"

arilotter — Tue, 27 Aug 2024 21:18:26 +0000

Paper & code in the next couple months. We're workin on em :)

New comment by arilotter in "DisTrO – a family of low latency distributed optimizers"

arilotter — Tue, 27 Aug 2024 20:38:18 +0000

We're pretty confident it's not a fluke, and paper + code are the next step, within a couple months. It's not "synchronize every step", but it's "do something every step".

We double and triple and quadruple checked our results, to make sure that we are in fact getting results like this while only doing our thing every step, and it really keeps holding up.

Don't trust our word for it, though, you'll see when the paper comes out :)

New comment by arilotter in "Show HN: Nous – Open-Source Agent Framework with Autonomous, SWE Agents, WebUI"

arilotter — Fri, 09 Aug 2024 17:37:53 +0000

I can confirm this is not a projected related to Nous Research in any way, just an unfortunate naming collision

New comment by arilotter in "macOS in QEMU in Docker"

arilotter — Wed, 31 Jul 2024 18:05:22 +0000

i remember making this joke a decade ago on the tonymacx86 forums, lots of people did it for the lulz

New comment by arilotter in "macOS in QEMU in Docker"

arilotter — Wed, 31 Jul 2024 18:04:38 +0000

you can! you can also run it on a real iOS device using this tech. it's explicitly documented in the repo :)

New comment by arilotter in "Meta has run hundreds of ads for cocaine, opioids and other drugs"

arilotter — Wed, 31 Jul 2024 18:03:35 +0000

Anecdotally, I get Instagram ads for "buy mdma online" all day, every day.

New comment by arilotter in "World_sim: LLM prompted to act as a sentient CLI universe simulator"

arilotter — Sat, 06 Apr 2024 05:00:13 +0000

(I work at Nous) it's Anthropic's Claude 3 Opus! Working around rejections is always tricky, and you gotta juggle getting responses to interesting queries with not breaking Anthropic's ToS