The entropy rate seems like a pretty natural definition of "entropy of a Markov chain", no? It's not exactly this but it's similar to "start at state i, end on state j (maybe in n steps?), what is the number of bits I need to send over the wire to tell you what path was taken".

What does the entropy of the raw stationary distribution give you? Is the entropy rate related to the entropy of the stationary distribution (the thermodynamic entropy?)?

    -\sum v_i p_{i,j} \log(p_{i,j})

[0] https://math.stackexchange.com/questions/1040972/entropy-of-...

The Markov chain provided as an example has the edge labels swapped (np should be qp and qp should be np). Regardless, what is the entropy of the example provided?

The problem with Markov chains is that states are dependent, so simply cataloguing states now violates the basic entropy calculation as neighboring states are now dependent on each other.

If the Markov chain is ergodic then maybe you can talk about the entropy of the stationary distribution? Then it's just $-\sum p_i lg(p_i)$ of the stationary distribution probabilities?

The article alludes to how entropy evolves. In the context of ergodic Markov chains, this is related to the size of the second eigenvalue?

It took 10-15 years before the stock market got back to the level it did pre dot-com crash [0].

[0] https://en.wikipedia.org/wiki/Dot-com_bubble

Part of the reason I'm dismissive of the current pushback against AI is that people have such a vague definition of it that it starts becoming all inclusive to subsume things like SQL, the Shazam algorithm, etc. Personally, I think it's a good reminder that SQL has quite a bit of intelligence in it. After all, SQL was one of the first mass successes of a declarative based engine.

Put another way, in some abstract sense, one of the differences between SQL query planning and an LLM is one of scale and compute. I wouldn't be surprised that, at some point in the future, we'll see LLM simulation in SQL(ite) akin to how people use different systems to run Doom.

[0] https://en.wikipedia.org/wiki/AI_effect

Comments URL: https://news.ycombinator.com/item?id=49073591

Points: 2

# Comments: 0

> If you refrain from participating in the software of the commons, the only thing that you're doing is surrendering more of our collective agency to abusive centralized powers.

[0]: https://www.youtube.com/watch?v=zLZwpH5lCD4&t=1622s

The article says (speculates?) that malicious users are trying to get privileged access for an edge in prediction market betting. From the article:

> If you could see The Numbers data before everyone else, every single week, you would have a significant edge over all the other traders - learning the answers slightly ahead of publication would allow you to front-run the trades.

This seems like a huge DoS security hole.

I encourage you to write a blog post about this. It seems especially relevant.

I'm absolutely no expert, I'm just reading about it now, but from the SQLite WAL documentation [0]:

> 7. There is the extra operation of checkpointing which, though automatic by default, is still something that application developers need to be mindful of.

and from their "checkpointing" documentation [1]:

> By default, SQLite does a checkpoint automatically when the WAL file reaches a threshold size of 1000 pages.

I'm only skimming but I see no mention of waiting for an idle time window.

Have you been successful in DoS'ing lobste.rs?

[0] https://sqlite.org/wal.html

[1] https://sqlite.org/wal.html#ckpt

Does anyone have a resource for something like this but under a libre/free license?

I don't think this is what's going on here but CC0 was expressly created because not every jurisdiction had a concept of "public domain", so a special license was needed to make sure it acted as if it were in the public domain for those cases.

From a CC0 FAQ [0]:

> Do I have to attribute the person who applied CC0 to their work?

> No, there is no legal requirement that you attribute the affirmer ...

From a Berlin Universities Publishing FAQ [1]:

> ... Since a waiver of copyright protection is not possible under German copyright law, CC0 is equivalent to a waiver of all possible rights and legal claims by the creator.

But, regardless, public domain or CC0 doesn't need attribution whether it's in the US or Germany.

[0] https://wiki.creativecommons.org/wiki/CC0_FAQ#What_is_the_di...

[1] https://www.berlin-universities-publishing.de/en/beratung/li...