The zip first suggestion seems that would be really inconvenient for around 95.8% of the world population.

Here all databases with personal information must be registered there and data must be secure.

In particular, put attention to this:

""" What happened to the Palestinians who were living there?

About 700,000 Palestinians were expelled or fled – about 85% of the Arab population of the territory captured by Israel – and were never allowed to return. Palestinians called the exodus and eradication of much of their society inside Israel the Nakba, or “catastrophe”, and it remains the traumatic event at the heart of their modern history.

Arabs who remained in Israel as citizens were subject to official discrimination. They were placed under military rule for nearly two decades, which deprived them of many basic civil rights. Much of their land was expropriated and Arab Israeli communities were deliberately kept poor and underfunded. """

Some people may want translation, mostly people that only speak a single language. But for most bilingual people, being forced a translation (a lower quality one), is a worse experience. I'm surprised that no one at Google has pushed back this anti-user behavior. It is like no one at Google knows more than one language.

The worst part is when traveling. Google ignores the browser settings, so it throws me Japanese or German website, even if my browser settings clearly says English then Spanish.

However, now I prefer to write directly in English and consider whatever grammar/ortographic error I have as part of my writing style. I hate having to rewrite the LLM output to add myself again into the text.

In a probability distribution model, the model is always forced to output a probability for a set of tokens, even if all the states are non sense. In an energy based model, the model can infer that a states makes no sense at all and can backtrack by itself.

Notice that diffusion models, DINO and other successful models are energy based models, or end up being good proxies of the data density (density is a proxy of entropy ~ information).

Finally, all probability models can be thought as energy based, but not all EBM output probabilities distributions.

So, his argument is not against transformers or the architectures themselves, but more about the learned geometry.

Do not offer me calls to action, I hate them.

The social networks are distributing such content AND benefiting from selling ads on them. Adding ads on top is a derivative work.

Personally I'm on the side of penalizing the side that provides the input, not the output:

- OpenAI training on copyrighted works. - Users requesting custom works based on copyrighted IP

That is my opinion on how it should be layered, that's it. I'm happy to discuss why it should be that way or why not. As I put in other comment, my concern is that mandating copyright filtering o each generative tool would end up propagating to every single digital tool, which as society we don't really want.