Hacker News: mezark

Tans: Precomputing RANS

mezark — Thu, 30 Apr 2026 13:39:12 +0000

Article URL: https://fergusfinn.com/blog/understanding-tans/

Comments URL: https://news.ycombinator.com/item?id=47962281

Points: 3

# Comments: 0

Also-RANS: Asymmetric Numeral Systems for Entropy Coding

mezark — Thu, 30 Apr 2026 13:38:45 +0000

Article URL: https://fergusfinn.com/blog/understanding-rans/

Comments URL: https://news.ycombinator.com/item?id=47962271

Points: 24

# Comments: 0

70x faster cold(ish) starts for SGLang

mezark — Fri, 24 Apr 2026 15:02:19 +0000

Article URL: https://fergusfinn.com/blog/fast-sglang-starts/

Comments URL: https://news.ycombinator.com/item?id=47891224

Points: 4

# Comments: 0

QueueSpec – drafting speculation tokens while a request queues

mezark — Mon, 26 Jan 2026 12:49:46 +0000

Article URL: https://blog.doubleword.ai/queue-speculation-drafting-while-you-wait

Comments URL: https://news.ycombinator.com/item?id=46765015

Points: 1

# Comments: 0

ZeroDP: Just-in-Time Weight Offloading over NVLink for Data Parallelism

mezark — Mon, 19 Jan 2026 12:37:58 +0000

Article URL: https://mainlymatmul.com/blog/zerodp/

Comments URL: https://news.ycombinator.com/item?id=46678316

Points: 1

# Comments: 0

Parallel Primitives for Multi-Agent Workflows

mezark — Wed, 14 Jan 2026 12:15:19 +0000

Article URL: https://fergusfinn.com/blog/parallel-primitives-blog/

Comments URL: https://news.ycombinator.com/item?id=46615169

Points: 1

# Comments: 0

New fastest AI Model Gateway – 450x less overhead than LiteLLM

mezark — Tue, 21 Oct 2025 13:23:58 +0000

Article URL: https://github.com/doublewordai/control-layer

Comments URL: https://news.ycombinator.com/item?id=45655480

Points: 2

# Comments: 0

New comment by mezark in "Should GPUs Make Free Trade Agreements?"

mezark — Fri, 19 Sep 2025 17:11:52 +0000

We look at how comparative advantage from economics applies to LLM inference - some GPUs are relatively better at FLOPs, others at memory bandwidth. What happens if you let each do what it’s best at?

Should GPUs Make Free Trade Agreements?

mezark — Fri, 19 Sep 2025 17:11:52 +0000

Article URL: https://www.doubleword.ai/resources/should-gpus-make-free-trade-agreements

Comments URL: https://news.ycombinator.com/item?id=45304031

Points: 3

# Comments: 1

New comment by mezark in "Our Small ML Team Beat OpenAI and Anthropic in a Specialized Domain [pdf]"

mezark — Tue, 11 Mar 2025 22:27:06 +0000

Huge congrats - and when you look at the latency graphs as well it really shows the value of these specialised systems!

New comment by mezark in "Controlled generation of OS LLMs – without impacting latency"

mezark — Sat, 28 Oct 2023 01:03:28 +0000

TitanML Takeoff Inference Server demonstrating controlled generation

Controlled generation of OS LLMs – without impacting latency

mezark — Sat, 28 Oct 2023 01:03:28 +0000

Article URL: https://www.youtube.com/watch?v=ih2SX2UsZQ0

Comments URL: https://news.ycombinator.com/item?id=38045956

Points: 7

# Comments: 1

New comment by mezark in "Takeoff Inference Server Is Now Open Source"

mezark — Tue, 01 Aug 2023 13:09:53 +0000

Drop in replacement for HF's TGI server. The fastest and easiest way to inference LLMs locally

Github: https://github.com/titanml/takeoff Docs: https://docs.titanml.co/docs/titan-takeoff/getting-started Discord: https://discord.gg/83RmHTjZgf

Takeoff Inference Server Is Now Open Source

mezark — Tue, 01 Aug 2023 13:09:53 +0000

Article URL: https://github.com/titanml/takeoff

Comments URL: https://news.ycombinator.com/item?id=36955485

Points: 3

# Comments: 1

New comment by mezark in "Falcon 7B running real time on CPU"

mezark — Thu, 06 Jul 2023 13:08:12 +0000

Hey there - TitanML is these guys: https://www.titanml.co/ . I think the impressive thing isn't actually whether the model is good (although it is a good model especially when fine-tuned) - but how fast this model runs on CPU with the TitanML server compared with before.

New comment by mezark in "Falcon 7B running real time on CPU"

mezark — Wed, 05 Jul 2023 19:37:01 +0000

Falcon 7B running real time on CPU

mezark — Wed, 05 Jul 2023 19:37:00 +0000

Article URL: https://www.youtube.com/watch?v=LvrEO_lNjcA

Comments URL: https://news.ycombinator.com/item?id=36605947

Points: 11

# Comments: 3

New comment by mezark in "Amazon Titan"

mezark — Fri, 14 Apr 2023 09:10:08 +0000

Annoying because they stole my company's name (TitanML - https://www.titanml.co/) Fortunately they haven't trademarked it, but still unideal.