Making terrible decisions, such as investing in distractions for your company and consumers, and then letting your workforce pay the tab.. is the thing that is not great for society.

Was this comment created using quantized llama 3?

I love Groq, but across every single line break in your post there is a glaring issue that is easy to refute with in 15 seconds, even without 300t/s of throughput.

But also, trust me bro.

The frontier labs have fantastic margin on inference. You do not understand how fantastic. And they have license to change inputs at will based on profitability.

They are not only innovating on models and tooling, they are innovating on cogs (I wrote this btw, and I’m not going to stop writing this way because Claude discovered it’s brilliant).

Speaking of models, the cost of training is not scaling nearly as fast as demand for inference. Training used to be the biggest cost by far, now it’s not.

So margin is increasing, and guess what else is happening? Customers are finding value. And the customers that are finding value are also the ones who happen to have huge enterprise budgets.

And while this is happening, so is implicit collusion (and lock in, and hype, and all that). And so prices are going up.

They’re going to be just fine man, there is no inference bubble.

They can modulate supply. It’s all going to be fine. You should invest.

This was after around 700 hours, which isn’t terrible, but working with their support is exhausting. I don’t think I’m going to touch it again until winter, unfortunately.

Thank you, my friend.