https://split-brain-ui.scalarxlm.com/docs/clients

I expect Claude to train on my general tokens. I train my own model on my IP related tokens.

I thought the challenge of programming 100,000s of cores using a mesh would be interesting so I wrote a simulator, simple compiler, and a few simple kernels for the wafer scale engine using publicly available documents.

I'm used to CUDA. So I asked: "How would you map something like CUDA onto a machine like this?" Well I use something like malloc to allocate global memory, memcpy to move between host and device memory, and a queue of launch thread block launches, but this time, thread blocks can communicate using nearest neighbor send/recv instructions within the same block instead of through shared memory on a streaming multiprocessor. This is inspired by the stencils in Tungsten.

The whole program is made up of a bulk synchronous kernel of many thread blocks.

I think it is interesting because CUDA has some hard limits on thread block sizes, but this mesh perspective lets you grow or shrink the blocks significantly.

Note that some information about cerebras wafer engines like the ISA is not public (as far as I know). In this code, I just guessed what it could be.

So this should not be taken as a faithful or accurate simulation of the wafer scale engine. More like a point on the design space that is similar in that it includes a wafer sized mesh of processing elements.

Comments URL: https://news.ycombinator.com/item?id=48537790

Points: 2

# Comments: 1

I expect them to train on their traffic, and I train on mine.

I’m not planning on firing people, but I am planning on building more, using more tokens, and less app subscriptions.

One aspect of building that doesn’t erode is human values.

LLMs don’t create software with zero direction and although I do have 12 agents building constantly, I run out of attention to increase that to 100.

Here’s a real example.

I’m in a design meeting talking about a model use case. We have a question about the data pipeline or the prompt format that would benefit from knowing about how the model was trained. The enterprise team lead calls the dev tech engineer from the company who produced the model. He is already in the office and walks into the meeting to answer the question.

Comments URL: https://news.ycombinator.com/item?id=48383111

Points: 3

# Comments: 0

Comments URL: https://news.ycombinator.com/item?id=48313880

Points: 2

# Comments: 0

I dropped scrum last year.

Then I realized how effective the fear was at fundraising...

Then I saw how effective it was at raising money.

You could spend 80% doing the work and 20% writing about it, or 99% doing the work and 1% copy-pasting Claude's writeup about it into a blog.

There is nothing wrong with writing if you are into it, and yes you can probably do better than Claude, but I can related to engineers who just want to build.