Hacker News: sacrelege

New comment by sacrelege in "N-Day-Bench – Can LLMs find real vulnerabilities in real codebases?"

sacrelege — Tue, 14 Apr 2026 17:02:58 +0000

no I don't, since there seem to be a silent degradation bug

New comment by sacrelege in "N-Day-Bench – Can LLMs find real vulnerabilities in real codebases?"

sacrelege — Tue, 14 Apr 2026 10:45:08 +0000

Ah thanks, I love coffee

At a high level, it's a mix of our own GPU capacity plus the ability to burst into external nodes when things get busy. Right now we're running a bunch of RTX PRO 6000s, which basically forces you into workstation/server boards since you need full x16 PCIe 5.0 lanes per card.

We operate a small private datacenter, which gives us some flexibility in how we deploy and scale hardware. On the software side, we're currently LiteLLM as a load balancer in front of the inference servers, though I'm in the process of replacing that with a custom rust based implementation.

We've only been online since the beginning of this month, so I can't really say much about the economics yet, but we've had some really nice feedback from early customers so far. :)

New comment by sacrelege in "N-Day-Bench – Can LLMs find real vulnerabilities in real codebases?"

sacrelege — Tue, 14 Apr 2026 10:27:59 +0000

We typically observe throughput of around 100–110 toks/s, and for larger context sizes this ranges between 90–100 toks/s.

While we don't guarantee a fixed toks/s rate, we scale by provisioning external GPU nodes during peak demand. These nodes run our own dockerized environment over a secure tunnel.

Our goal is to ensure a consistent baseline performance of at least 60–80 toks/s, even under high load.

New comment by sacrelege in "N-Day-Bench – Can LLMs find real vulnerabilities in real codebases?"

sacrelege — Tue, 14 Apr 2026 02:54:42 +0000

Thanks for putting N-Day-Bench together - really interesting benchmark design and results.

I'd love to see how the model we serve, Qwen3.5 122B A10B, stacks up against the rest on this benchmark. AI Router Switzerland (aiRouter.ch) can sponsor free API access for about a month if that helps for adding it to the evaluation set.

New comment by sacrelege in "Bitcoin is a disaster"

sacrelege — Fri, 01 Jan 2021 17:22:20 +0000

the posted thread is rather interesting and I would love to see more critical discussions like this on the issues of bitcoin. unlike the often seen circle jerk of bitcoin maxis, this could actually lead to solutions or issues getting addressed before they become bigger.

New comment by sacrelege in "3D printed 3-sided cryptocurrency themed LED lamp"

sacrelege — Thu, 10 Dec 2020 23:56:05 +0000

I'm proud of my work, I hope all of you like it too :)

3D printed 3-sided cryptocurrency themed LED lamp

sacrelege — Thu, 10 Dec 2020 23:56:05 +0000

Article URL: https://bitlamp.ch

Comments URL: https://news.ycombinator.com/item?id=25380462

Points: 1

# Comments: 1