Comments URL: https://news.ycombinator.com/item?id=49287753

Points: 2

# Comments: 0

Sorry if I was too harsh, it’s just that my perception watching the repo has been that the llama.cpp devs are by far the most cautious and slow moving of all the inference implementations, so I found your perspective a bit surprising, I do think that the desire for stable software that never break, and software that supports the latest models and devices/device API’s are conflicting, nothing will do both, and I think that llama.cpp devs do a good job of balancing between shipping features and not breaking users.

The level of observability and risk involved in using the entire nation’s police resources is extremely high, whoever asks for that much resources will have to account for what they are doing and many of the details of the event are likely to be scrutinized by many parties, media, other departments, etc. It is unlikely to be wielded to abuse or strip civil liberties or to harass people, as we’ve seen ALPR’s be used

For example, an officer sitting on a city street is very unlikely to learn where his wife goes every day, an ALPR search will answer that question.

An officer walking along the street making note of what he sees is very unlikely to observe and make note of the precise daily movements of someone in August three years ago, an ALPR search will answer that question.

The degree/kind distinction you’re aiming at is meaningless, it’s like trying to argue that shooting someone with a firearm is the same as shooting someone with a paintball gun in principle, sure but maybe one of them is orders of magnitudes morw powerful and impactful, and so deserves a different degree of consideration in how and when it is applied?

Yes ideally there would be testing every hardware + software combo but this costs engineering time and $$$ money, and you are running on master branch, no master branch of any software is stable, inherently, if you run into issues, just stick to the old hash where stuff worked, why are you insistent on both being at the bleeding edge and experience 0 breakage!

But yes, still trusting the project with arbitrary code execution on your machine, including build formulas that pull stuff from the internet and suffer from all the above anyways

mass surveillance is totally orthogonal and will not reduce disorder or disregard for laws.

we know that empirically from the last twenty or so years where mass surveillance has only gotten more and more aggressive, while at least in cities: decay and disorder are rising.

All that instead of a jellyfin server and a single search? It’s all gymnastics just different gymnastics