Hacker News: backpropaganda

Some Remarks on Large Language Models

backpropaganda — Tue, 03 Jan 2023 15:54:22 +0000

Article URL: https://gist.github.com/yoavg/59d174608e92e845c8994ac2e234c8a9

Comments URL: https://news.ycombinator.com/item?id=34233033

Points: 182

# Comments: 79

Data Is a Public Good

backpropaganda — Thu, 29 Dec 2022 19:44:24 +0000

Article URL: https://zswitten.github.io/2022/04/24/data-public-good.html

Comments URL: https://news.ycombinator.com/item?id=34176982

Points: 2

# Comments: 0

New comment by backpropaganda in "The Need to Read"

backpropaganda — Sat, 26 Nov 2022 11:50:54 +0000

Good video content is created by first writing the script.

New comment by backpropaganda in "The Illustrated Stable Diffusion"

backpropaganda — Wed, 05 Oct 2022 01:02:31 +0000

Yes, I can read it perfectly fine. It relies on a lot of notation that AI researchers are familiar with.

New comment by backpropaganda in "C Template Library"

backpropaganda — Wed, 30 Dec 2020 20:04:11 +0000

How would I include the definitions without the implementations?

New comment by backpropaganda in "I open sourced my game along with a tutorial on how to make it using Lua"

backpropaganda — Mon, 06 Jul 2020 10:15:50 +0000

It's Lua. They use Love2D.

New comment by backpropaganda in "Godot 4.0 will get a new lightmapper"

backpropaganda — Sun, 10 May 2020 01:29:21 +0000

FNA, Monogame, Heaps, Kha, and many other open source engines have closed source forks supporting consoles.

New comment by backpropaganda in "World Models (the long version)"

backpropaganda — Mon, 27 Apr 2020 07:34:04 +0000

World Models is a good paper, but is definitely not the top three most significant RL papers.

New comment by backpropaganda in "Jax – Composable transformations of Python and NumPy programs"

backpropaganda — Wed, 08 Apr 2020 20:49:34 +0000

But is autodiff combined with a blackbox jit a real solution? The jit either works for your new model or it does not. If it does not, you can do pretty much nothing about it, other than ping jax authors or get your own hands dirty with jax internal code. Why is noone working on a usable low-level framework, where I can implement QRNN or more complicated stuff without relying on a black-box jit? Jax could have chosen to be this, but instead is a fancy solution to a non-problem.

New comment by backpropaganda in "Contrastive Self-Supervised Learning"

backpropaganda — Sun, 02 Feb 2020 01:15:54 +0000

CPC trains neural nets.

New comment by backpropaganda in "An Opinionated Guide to Machine Learning Research"

backpropaganda — Sat, 01 Feb 2020 12:11:54 +0000

You only need a few seconds to read the title, and you can cut away 150 out of those 200 with that. If it's a paper simply not in your area of research, you don't need to bother. You can then read the abstract (30 seconds) for the rest, and finally you'll pick 5-10 papers to read. You'd skim them with 5-10 mins per paper, and if you like what you see in 1-2 papers, you'll give it a more through read. So this is 10 mins + 30 mins + 2 hours + buffer, which is at best 3-4 hours.

Of course this requires a strong filter at the first stage. You can also set aside time to investigate specific topics outside your work, but you won't do that as often as you keep up with your own literature.

New comment by backpropaganda in "Fashionable Problems"

backpropaganda — Sun, 22 Dec 2019 20:16:58 +0000

So in the case of AI/ML, the fashionable new thing is unsupervised learning, self-supervised learning, reinforcement learning, GANS, etc. The played out problems are image classification, speech recognition, etc.

New comment by backpropaganda in "Sundar will be the CEO of both Google and Alphabet"

backpropaganda — Wed, 04 Dec 2019 10:00:09 +0000

It's in the nature of social networks that new social networks don't look like old ones. Youtube is definitely a social network, and so is Twitch, Discord, TikTok, etc. Youtube has the additional advantage of having persistent count, so I would count on Youtube lasting much longer than any other social network whose popularity changes generation to generation.

New comment by backpropaganda in "OpenAI Releases Largest GPT-2 Text Generation Model"

backpropaganda — Wed, 06 Nov 2019 01:16:36 +0000

Given sibling comments, this seems relevant: https://www.lesswrong.com/posts/4AHXDwcGab5PhKhHT/humans-who...

New comment by backpropaganda in "How Untitled Goose Game became a real video game"

backpropaganda — Tue, 29 Oct 2019 20:03:20 +0000

People were meme-ing the goose game hard much before its launch, and much before Dunkey covered it, but that probably helped sustain its exponential growth.

More than streamer-friendly, it's Reddit- and Twitter-friendly. Any small clip of the game is automatically funny and share-able. The bird's simple design makes it easy for fan artists to make more memes.

New comment by backpropaganda in "After discovering he has at least 17 kids, man sues fertility clinic"

backpropaganda — Thu, 03 Oct 2019 19:41:35 +0000

What do you think about this: https://en.wikipedia.org/wiki/Genetic_sexual_attraction ?

Did you notice that you were particularly attracted to any of your half-siblings?

New comment by backpropaganda in "Get Started Making Music"

backpropaganda — Mon, 16 Sep 2019 06:18:02 +0000

POs were a bit too limited for me. The sequencer isn't powerful enough to make anything more complex than basic chiptunes.

Not to diss on PO. I was super hyped about it as well, and would have liked to know about its limitations before buying it. Anyone of the numerous phone apps would be a cheaper and better replacement for a PO.

What got me started in music was Garageband. It's free (for macos users) and quite simple and intuitive. It's not as fully-featured as something like Ableton, but quite capable for making professional-level songs.

New comment by backpropaganda in "Remove Richard Stallman"

backpropaganda — Sat, 14 Sep 2019 02:23:59 +0000

Alec Holowka was a game dev who committed suicide recently after allegations of sexual assault by ex-girlfriend Zoe Quinn. He was the developer behind Night in the Woods. The NitW studio said they've cut ties with him after Quinn's allegations.

New comment by backpropaganda in "A Walk in Hong Kong"

backpropaganda — Fri, 16 Aug 2019 15:58:54 +0000

This is just plain factually incorrect. Around two million Chinese immigrate to other countries every year (net).

Note also that it's similar to India's immigration rate, while India is doing much worse economically than China.

Source: https://en.wikipedia.org/wiki/List_of_countries_by_net_migra...

New comment by backpropaganda in "A Walk in Hong Kong"

backpropaganda — Fri, 16 Aug 2019 15:46:00 +0000

What is this thought experiment meant to say? If the people of Liverpool or San Francisco want freedom and make their own country, many in the west would support such a thing. After Trump got elected, the separationism meme was spread in California half-seriously.

The reason this thought experiment doesn't really work is that it disregards a crucial piece of information that the CCP is an authoritarian regime, while the people of Hong Kong are liberal and democratic. People generally prefer to move from the former to the latter, and not from the latter to the former.

I think history is useful, but it doesn't really change the fact that the people of Hong Kong do not want authoritarianism. It should be irrelevant what some king in the Qing dynasty or British empire did. As common folk ourselves, we should be giving more value to the will of the people, than the will of people who buy and sell countries and its people as if it was private property. So, no, Hong Kong does not "belong" to CCP just because at some point it "belonged" to Qing dynasty.

Talking about people as if they are property of kings and rulers is just slavery at the level of groups.