Baring it all to software: Raw machines | IEEE Journals & Magazine | IEEE Xplore https://share.google/nI9GyFJu4HvbYFrBf

(If you Google the name you will find free PDFs as well, the IEEE page is more useful as a summary and such.)

Edit: But to be fair... The biggest reason it's expensive is likely that companies like to make money.

But it's only possible to make custom ASICs when you have a specific problem to solve. For newer crypto systems they can vary enough parameters that building a flexible enough ASIC to recoup the investment before the algorithm changes and makes your hardware useless.

For problems where the problem to solve remain in the problem space the ASIC can solve there is no point to use a thing else.

Eg the M4 Max 128GB has a bandwidth speed of 500GB/s+. And that's true for other models as well.

But as you note, the base speed has also increased over the versions.

My old 3090 is typically significantly faster (almost 2x token/s) than my M4 Max 128GB machine, as long as the model fits in the 24GB of VRAM.

In most situations it's a better idea to just buy tokens. But there are definitely cases when that's not an option. And then a machine like the M5 Ultra can allow you to do things locally for a fairly limited budget. And in a simpler package to manage than a machine with multiple GPUs.

Wherever you are you can probably find a local store that sells and services Macbooks. So if your machine is damaged during a trip you can get it fixed, or buy a replacement on the spot, and at least get through the work you are there to do.

For small-ish companies that can be a very useful feature.

A while back a listened to a podcast where they interviewed people doing this and it was quite interesting. (And it's an engineering podcast so many technical details.)

https://softwareengineeringdaily.com/2024/05/24/bonus-episod...

Going from a story where societies and not individuals are the "heroes" to people with magical powers.

Given their estimates of a Mac being able to generate $1k (per month?) a 5090 with a lot more power would be able to generate $50k. For a $3k piece of hardware. Which is obviously not realistic. (As in, nobody is paying that much for the images, which seems to match well with no actual requests on the system.)

If that's too annoying then bad parking by school areas so the situation doesn't happen.

Claude code (arguably the most recent large change, even if it wasn't the first of it's type) was released one year ago.

After watching the video I'd say that it is similar to my own reaction when opening my own code that is 2 years old. (To be clear, code I myself wrote 2 years ago, without AI.) Or even more realistically, code I wrote 6 months ago.

Buy it mostly reads like someone making an exaggerating claim to get s boost from a populist narrative.

With "normal use" you're unlikely to hit the limit though, unless you only use the Opus model and do things in parallell.

If you have a number such locations with alternatives then you can make a number of identifiable versions by combining alternates.

"I want you to do feature X. Analyse the code for me and make suggestions how to implement this feature."

Then it will go off and work for a while and typically come back after a bit with some suggestions. Then iterate on those if needed and end with.

"Ok. Now take these decided upon ideas and create a plan for how to implement. And create new tests where appropriate."

Then it will go off and come back with a plan for what to do. And then you send it off with.

"Ok, start implementing."

So sure. You probably can work on this to make it easier to use than with a CLI chat. It would likely be less like an IDE and more like a planning tool you'd use with human colleagues though.

iOS and Android less so (even if there is a one time charge for Android and a yearly charge on Apple). OTOH I have not heard of them usually reaching out to more than a handful of devs for promotion purposes.