New comment by goosers in "LLM from scratch, part 28 – training a base model from scratch on an RTX 3090"

goosers — Wed, 10 Dec 2025 08:36:23 +0000

I’m experimenting with this, but using the CPU not the GPU. I’m finishing up writing the series now, but focused more on understanding the architecture than trying to build a useful model. Mine requires talking in the language of Shakespeare, and getting replies in the same, a proof of concept more than a useful tool. https://www.tag1.com/white-paper/part1-tokenization-building...

I was interested in focusing on repeatability and using text sources anyone can legally obtain. It’s been fascinating, but after much experimentation it’s clear that working with more text and more diverse text would be extremely helpful.

Beyond the Magic: How LLMs Work

goosers — Tue, 28 Oct 2025 10:21:19 +0000

Article URL: https://www.tag1.com/white-paper/how-llms-actually-work/

Comments URL: https://news.ycombinator.com/item?id=45731075

Points: 1

# Comments: 0

Hacker News: goosers

New comment by goosers in "LLM from scratch, part 28 – training a base model from scratch on an RTX 3090"

Beyond the Magic: How LLMs Work