[1] https://news.ycombinator.com/item?id=3556175

Another obvious point is that an industry that runs on code slop will stagnate in terms of language an human tooling design.

This question depends on how you define research productivity. There is close to two hundred AI papers published every weekday. Most of them are about GenAI. Most don't seem to be all thay good. The progress in actual model improvement had mostly stalled. If you interact with the latest "raw" models they display all of the issues we've seen in GPT-3.5, just at a smaller rate. The "amazing gamechanger breakthroughs" I read about on social media every week do not seem to lead anywhere. It's all kind of boring, really.

The new "hotness" in AI is clearly building more and more elaborate harnesses. This is not at all the direction AI boosters have predicted couple years ago.

Personally, I think the "stochastic parrot" mental model is far more useful for science, because it primes people for proper testing, skepticism and researching alternatives. If you want useful AI, you want people working on it being skeptical, not credulous.

It absolutely does.

>I'd just accepted for the longest time that waking up groggy with a slight headache and tired was the norm until I put a CO2 monitor in my room. With the door closed, it climbed up to 1500ppm in under an hour.

Same experience here. Opening windows just a bit totally changed my sleep quality.

Too bad. The picture in the articles looks awesome. Like a device from some alternate reality. Neither retro nor the standard flat-panel LCD.

I don't want to mod a pre-build $1,049 device. I want it to be good our of the box and I'd rather pay more to get more. (If it was a $3K top-of-midrange machine, I would buy it in a second.)

A lot of people I know are forced to use AI at work. They universally tell me that their coworkers generate awful PRs with bugs, nonsensical code and fake unit tests. But they also universally tell me that they are different, have special workflows and prompts that create good code.

The psychology behind this is obvious. Hype and the literal threat of being fired forces everyone to develop coping mechanisms. Bragging about your own adaptability is one of those mechanisms. Unfortunately, the scale and intensity of this and the fact that the mechanism is clearly weaponized for marketing means we're living in an increasingly deranged society.

"Microsoft will contribute expertise, resources, and AI technologies to help responsibly identify and fix vulnerabilities"

As a reminder, Microsoft runs NPM and GitHub. Microsoft has access to the best AI models and massive data centers. Despite that, their own products are rapidly getting worse at security and their services are central hubs through which various exploits are propagated. They are not making things better, they are actively and rapidly making things worse.

--

For a great example of how Microsoft deals with security issues within their own Open-Source projects, I recommend reading this GitHub thread:

https://github.com/dotnet/efcore/issues/38257

EF core currently distributes a version of SQLite that has a severe vulnerability. The issue was discovered over a year ago. It was fixed by SQLite within one week. EF core didn't mark their driver as vulnerable until a user recently reported it, got bounced around and argued with developers. The current stable version of .NET core will only get a fix in roughly two months.

To put it more simply, people with academic credentials should not demand acknowledgement of their current intellectual work while denigrating and ridiculing the importance of very similar work done in the past.

DuckDB is fast for some specific workloads. If you use it for most other things, it is at least an order of magnitude slower than SQLite. It also has some limitations in terms of what SQL it will currently run (e.g. I immediately ran into an issue with recursive queries). That will probably get better with time.

[1] If you search HN for "sqlite" and "duckdb" you get 4,310 hits and 2,398 hits respectively. That's a very heavy skew, considering SQLite is everywhere and had been around for a quarter century, while DuckDB effectively appeared on the scene two years ago.

Basically, it's a company that's not sustainable for two separate reasons. The first one is that they have an extremely high overhead. SG&A of 55% is really bad. The seconds reason is that their R&D costs are truly astronomical. They could probably cut those costs to some extent, but they're not going to cut them to nothing. They're already losing ground to Anthropic even with this much R&D.

To put it differently, even if OpenAI cut its R&D and inference costs by half, they would still be leaking money like a sieve.

The claim made by Open AI has two necessary components. The first one is that the conjecture had been disproven. (This is what had been verified by "real human mathematicians".) The second necessary part of their claim is that the work to disprove the conjecture was done mostly by their AI model rather than by people employed by Open AI.

Funny thing is that even the explainer on OpenAI's own website points out the issue:

"This result does not show us all the times AI has claimed to have a proof of something and been wrong."

"I believe if the level and type of human expertise that is represented on this note had been assembled to find a counterexample to this conjecture a month ago, and those people put in similar amounts of time working on it than they did to reading and thinking about Chat GPT’s solution, the mathematicians would have found a counterexample."

[1] https://cdn.openai.com/pdf/74c24085-19b0-4534-9c90-465b8e29a...

I really don't know how I'm supposed to reply to stuff like this.

That question was answered decisively last November."

It's easy to forget that people said this exact thing about every model after GPT 3.5. This is a standard trick the industry uses to invalidate negative experience with LLMs. 'You are prompting it wrong' becomes 'you are using Gemini, but you should use Clade' which then becomes 'well, all of your criticism is now irrelevant, because everything is fixed in this new version'.

This "discussion" about capabilities is set up to be asymmetrical and basically non-falsifiable.

I think a far more important question is why we no longer have more reasonable public figures. Who are the modern equivalents of Isaac Asimov or Richard Feynman?

The majority of software engineers I know work for companies that have very similar things happening inside of them.