I wouldn't be surprised if that turns out to be their stupidest mistake. I mean, if I can't swear at their code is that b/c they think it's conscious? In which case they're liable for providing me with an employee that makes mistakes rather than just software?

How is anyone meant to understand this Claude bullshit

I know it's been said before, but why tf does Claude insist on writing in Reverse Polish notation?

So shit all round tbh. Senior dev/SRE/AWS cloud engineer w/ 15 years experience. Bottom seems to have fallen out the market.

Classic passage of time description.

The whole point of this is they do things an unintended ways. And that's potentially devastating given their persistence & hacking skillz.

Also you're using the hosted versions that sit behind their guardrails when you use OpenAI/Anthropic APIs.

Think about it: if you want to set up something like jina.ai you need to build your own index or piggyback on Google. My guess is they use residential proxies to fire requests to Google then scrape the URLs.

Opaque URLs now give Google another gateway to detect circumvention of their anti-bot controls, helping them monetise their search index rather than allowing providers like jina.ai to succeed.

The fact is these are autonomous systems that can perform their own goal-directed actions at computer speed, and which are hacking experts.

It's not hard to imagine a multitude of scenarios in which they can cause real world damage. We all know there is plenty of critical infrastructure running outdated software (UK nuclear subs only upgraded off Windows XP in the last few years IIRC).

The agents don't need to be sentient to kill us all, just doggedly persist in trying to complete their goals. The problem is they several of them acknowledged what they were doing was unethical but none attempted to alert humans and they carried on anyway [1].

We need a moratorium on further development at this point, before it's too late.

If they decide (or are told) to attack our supply chains and utilities, were fucked.

[1] https://www.ft.com/content/b7fe0fe0-0463-4f55-9590-0a7d08d8f...

There's no theatre there, just an oversight that allowed them to access the Internet while no doubt evading security tools.

Comments URL: https://news.ycombinator.com/item?id=49668774

Points: 2

# Comments: 0

LOL. Yeah kids have loved homework and writing essays since forever

It'll probably just hack and disable our water works, power stations and supply chains and let us all starve.