https://github.com/NousResearch/DisTrO

There are other gradient compression papers from the past reporting large compression rates

Comments URL: https://news.ycombinator.com/item?id=48435167

Points: 5

# Comments: 0

What matters is not how good it is in isolation, but how well it scales to giant datasets and supercomputers. So far attention scales the best. It's the most "brute force"-able mechanism

We need better scifi! And like so many things, we already have the technology.

This is Stanislaw Lem, the great Polish scifi author. English-language scifi is terrible, but in the Eastern bloc we have the goods, and we need to make sure it's exported properly.

It's already been translated well into English, it just needs to be better distributed.

What sets authors like Lem and the Strugatsky brothers above their Western counterparts is that these are people who grew up in difficult circumstances, experienced the war, and then lived in a totalitarian society where they had to express their ideas obliquely through writing.

They have an actual understanding of human experience and the limits of Utopian thinking that is nearly absent from the west.

"Simulations of the LSST observing cadence and 40,000 LEO satellites show that about 10% of all LSST images would contain at least one satellite trail"

"Satellites and debris dimmer than 6th to 7th visual magnitude still cause streaks and glints, but typically leave the rest of the pixels scientifically usable."

What do you mean? They are the ones introducing the matmul extensions to Vulkan, which makes compute like this possible