Hacker News: d4l3k

New comment by d4l3k in "Fault Tolerant Llama training"

d4l3k — Mon, 07 Jul 2025 15:49:55 +0000

We're working on making these composable. torchft is largely focused on the model integration and algorithms where as Monarch is handling more of the orchestration/monitoring. They operate at a bit of a different layer but the plan is to have torchft have the fault tolerant algorithms that can be used both in Monarch or a standard PTD job

New comment by d4l3k in "Fault Tolerant Llama training"

d4l3k — Fri, 27 Jun 2025 18:37:21 +0000

We want to be tolerant to application bugs and host/GPU failures that can be solved by replacing/restarting the machine. External services and network failures we don't have much control over so aren't aiming to solve that.

For specific types of failures check out the section on "Reliability and Operational Challenges" from the Llama 3 paper https://ai.meta.com/research/publications/the-llama-3-herd-o...

New comment by d4l3k in "Fault Tolerant Llama training"

d4l3k — Fri, 27 Jun 2025 17:10:11 +0000

Let me know how it goes! If you're interested in chatting / run into any problems feel free to reach out via the links in my profile

New comment by d4l3k in "Fault Tolerant Llama training"

d4l3k — Fri, 27 Jun 2025 17:07:10 +0000

Recently there's been a lot of interest and improvements in semi-synchronous training. The Streaming DiLoCo paper came out this year and is a big step forward for datacenter semi-sync.

Historically it's been limited to areas like federated learning for low power/low network training but with the massive increase in number of GPUs it's becoming relevant even for training in datacenters.

It is another variable ML researchers have to tune so does add some complexity and I expect most folks just aren't familiar with it yet.

On "typed language": all of torchft is typed! The coordination/quorum layers are written in Rust w/ GRPC and the front-end is typed Python with Pyre since it has to interact with PyTorch and model code.

New comment by d4l3k in "Fault Tolerant Llama training"

d4l3k — Fri, 27 Jun 2025 01:45:22 +0000

Hey Tim, how's it going?

Interested in lending PyTorch some compute? :)

torchft can handle much larger scales but for public multi-day demonstration run this is what we had available. Point of this blog was to demonstrate correctness of the quorum algorithm and recovery with a stock PyTorch stack and not so much peak flops.

Stay tuned though -- planning on doing some much larger demos on B200s!

New comment by d4l3k in "Fault Tolerant Llama training"

d4l3k — Fri, 27 Jun 2025 00:16:01 +0000

Hey, nice to see this here!

I'm the primary author so happy to answer any questions you might have!

New comment by d4l3k in "Yabai – A tiling window manager for macOS"

d4l3k — Thu, 30 Nov 2023 18:07:43 +0000

It seems to work just fine with SIP enabled. I just switched and it seems to be a lot better than Amethyst. Amethyst had a lot of issues with focus follows mouse and dropdown dialogs that seems to just work with Yabai

Seems like SIP is only needed for system dialogs etc so has the same limitations as Amethyst

New comment by d4l3k in "Hackers manage to unlock Tesla software-locked features"

d4l3k — Thu, 03 Aug 2023 20:16:56 +0000

Not sure why they aren't loading, seem to be fine now

They're also at https://github.com/d4l3k/fn.lc/tree/master/static%2Fdiy-self...

New comment by d4l3k in "Hackers manage to unlock Tesla software-locked features"

d4l3k — Thu, 03 Aug 2023 20:15:09 +0000

Supercharger auth is between the car and the charger and doesn't require an internet connection. I get billed the normal way via my Tesla account since the VIN is registered

New comment by d4l3k in "Hackers manage to unlock Tesla software-locked features"

d4l3k — Thu, 03 Aug 2023 17:59:27 +0000

There's some functionality loss but it's mostly been mitigated. I have a custom app I wrote since I can't use the stock app.

The one feature I miss is that there's no voice commands since that requires Tesla's servers but at the same time I also haven't been bothered enough to plug in a custom backend

New comment by d4l3k in "Hackers manage to unlock Tesla software-locked features"

d4l3k — Thu, 03 Aug 2023 17:55:30 +0000

I've got a blog if you're interested haha https://fn.lc/post/

I've been hacking on my car and creating my own self driving models

Code is at https://github.com/d4l3k/torchdrive

New comment by d4l3k in "Hackers manage to unlock Tesla software-locked features"

d4l3k — Thu, 03 Aug 2023 17:42:09 +0000

If the map can't talk to Tesla it'll use Google maps directly. I usually don't allow connections to Tesla on my rooted Model 3

New comment by d4l3k in "Tailscale bug allowed a person to share nodes from other tailnets without auth"

d4l3k — Wed, 18 Jan 2023 03:17:51 +0000

I just tried to set this up and couldn't. Seems like it's invite only with a waitlist :/

New comment by d4l3k in "Mosh: The Mobile Shell"

d4l3k — Thu, 12 Aug 2021 04:01:25 +0000

Adding port forwarding to Mosh has a $600 bounty -- highest OSS bounty I've ever seen

https://www.bountysource.com/issues/4471419-ssh-port-forward... https://github.com/mobile-shell/mosh/issues/337

New comment by d4l3k in "Two people killed in fiery Tesla crash with no one driving"

d4l3k — Sun, 18 Apr 2021 20:21:39 +0000

They measure torque on the wheel from the drivers hand. It is possible to fool via defeat devices etc (ex www dot autopilotbuddy dot com).

There is a WIP system that uses the selfie camera to monitor the driver but it's still possible to fool (image taped in front or block it with tape etc) so unlikely it can catch all cases of drivers being willfully being dangerous. https://twitter.com/greentheonly/status/1379928419136339969

New comment by d4l3k in "Two people killed in fiery Tesla crash with no one driving"

d4l3k — Sun, 18 Apr 2021 20:18:24 +0000

They are working on a camera based solution though it's imperfect. You can see examples of it running at https://twitter.com/greentheonly/status/1379928419136339969

New comment by d4l3k in "Tesla – How to Enable Developer Mode and Other Secret Modes"

d4l3k — Thu, 28 May 2020 05:22:35 +0000

Post can also be accessed via IPFS https://gateway.ipfs.io/ipns/Qmea45XwFtdwaCGAPLRMxFmoUP5YLnk...

I've spent a lot of time digging into the Tesla software and hardware. Let me know if you have any questions! :)

Tesla – How to Enable Developer Mode and Other Secret Modes

d4l3k — Thu, 28 May 2020 05:20:03 +0000

Article URL: https://fn.lc/post/tesla-model-3-modes/

Comments URL: https://news.ycombinator.com/item?id=23333650

Points: 1

# Comments: 1

Hacking My Tesla Model 3 – Internal API

d4l3k — Tue, 26 May 2020 16:00:35 +0000

Article URL: https://fn.lc/post/tesla-model-3-services/

Comments URL: https://news.ycombinator.com/item?id=23312814

Points: 3

# Comments: 0

New comment by d4l3k in "Show HN: Hacking My Tesla Model 3 – Security Overview"

d4l3k — Wed, 13 May 2020 09:23:05 +0000

I've spent a lot of time digging into how the Model 3 works internally (not just the security aspects) so happy to answer any questions you might have! :)

The post is also available on IPFS at:

https://gateway.ipfs.io/ipns/Qmea45XwFtdwaCGAPLRMxFmoUP5YLnk...