Comments URL: https://news.ycombinator.com/item?id=50259487

Points: 3

# Comments: 0

They want the device to be a mechanism for you to purchase things. Hence the “Apple card” and all the hullabaloo around that. You’ll only use your phone if you perceive it to be secure. Apple’s investments in Secure Enclave’s, sandboxing are all directly linked to their belief that this will help the consumer perceive the safety of the product- and again, it goes back to the perception of the brand.

Quality craftsmanship has properties that outsiders can perceive- even if they don’t understand it. Apple makes those investments.

Google- well, they just make things and then abandon them. Android’s bizzaro world open source is a chaotic mess that reflects the lack of discipline in Google’s leadership.

I don’t think this is a societal problem- it’s that people with the endurance for a “career” in this field succeed through the establishment of co-dependent rat-kings for organizational structure.

I have to observe:

Seeing the raw CoT is the best signal for evaluating prompt efficiency. The fact that frontier providers don’t share this feels criminal after this last weekend. They’ve played us all for fools.

Thanks for the token setting observation. I’m running ollama headless and from the command line. I didn’t even know there was a web ui. Conf file is pretty straightforward though.

I settled on 64k tokens because of a recommendation from an LLM. I now see that that guidance is associated with similar sounding (but not the same) configuration constraints. So this weekend I’ll try turning it to 11 (250k tokens?). Anticipating some hard locks over here.

Using frontier providers to manage prompt tuning experiments has been very exciting. Might be something there.

Dario’s behavior this weekend made me feel like this just needed to get out quick. In the future, I’ll be sharing more details about some other things in the process and some ways I found to use automation to accelerate splitting prompts for use on local inference.

Comments URL: https://news.ycombinator.com/item?id=49697014

Points: 140

# Comments: 76

I am no longer and will never again be interested in Bill Gates’ opinion about anything. He needs to retire. He’s a sclerotic representative of what needs to be left behind.

Thank you for your contributions, Bill. You’ve done enough.

It's looking like 3GPP is shifting away from faster networks and into networks that are programmable, energy-budgeted platforms.

Anybody doing experiments with components where power is transmitted by a transport provider? Ambient IoT sounds like a classic 3GPP proposal that utterly fails because every time they publish, nobody follows on with legitimate investment. Am I too cynical?

Comments URL: https://news.ycombinator.com/item?id=48746915

Points: 3

# Comments: 0

I had a post on here this week that was briefly popular. There were numerous folks who posted that the material “wasn’t new.”

I felt like it should be implicit that people who already know what I was writing about are not the target audience. But here they were, commenting.

At the same time, the page got upvoted quite a lot and the comments were filled with folks who had lots of interesting reactions and additions. Despite the fact that this was “old news”, it seemed implicit that for many it was new news.

Sometimes we should trigger conversation. I believe we shouldn’t index on novelty- we should index on impact. Your post is a nice defense of those who discover and share what they discover.

You are correct in my intentions on this post generally.

I want to highlight:

I want to measure performance of the LLMs over time- which includes assessing the quality of their outputs. I don’t perceive the reasoning output to be anything other than a measurable signal of possible drift in model performance.

Except it isn’t, because I’m only getting a low value summary of the thinking.

It’s like asking your buddy how fast he thought that last pitch was when radar guns are behind the plate.

Yeah, it’s a description related to what happened, but it’s not the thing I want to measure.