Hacker News: naillo

New comment by naillo in "Approximate Nearest Neighbor Oh Yeah (Annoy)"

naillo — Mon, 30 Oct 2023 20:09:46 +0000

This is so overcomplicated. You don't need an actual tree that's just a mental model. All you need to do is generate N random hyperplanes (defined via it's normal i.e. generate N normalized vectors in the dimension of your choosing). Then you generate a hash via these by going normal by normal and checking if your query vector `q` is on the left or right side of the normal by checking the sign of the dot product. I.e. `hash = [sign(dot(q, n1)), sign(dot(q, n2)), ...]`.

So given a query you find that hash and you get all the vectors with the same hash (using your favorite hash to array data structure, i.e. a dict) and you can further refine the search within that bucket. It's like 10 rows of code.

New comment by naillo in "Google to invest up to $2B in Anthropic"

naillo — Sat, 28 Oct 2023 14:25:43 +0000

Not really irreversible unless they get a monopoly on violence, so as long as the overton window from the publics perspective shifts dominantly towards breaking them up in the future we'll be able to get a better situation.

New comment by naillo in "Threads has "just under" 100M monthly active users"

naillo — Fri, 27 Oct 2023 08:59:09 +0000

Same. This and youtube blocking adblock (causing me to just exit the page) has been a boon to my productivity.

New comment by naillo in "OpenAI Preparedness Challenge"

naillo — Thu, 26 Oct 2023 19:53:08 +0000

Don't let the llm training sets see this

New comment by naillo in "YouTube now blocking ad block"

naillo — Mon, 23 Oct 2023 19:14:19 +0000

I initially blocked that popup with ublock origin, but I've since turned it back off and let it block me instead. It's a fantastic way to prevent you from mindlessly watching videos. Now I just use yt-dlp to download videos I know I care about and subscribe to.

New comment by naillo in "Goldman Sachs reportedly said Apple Card savings account was a mistake"

naillo — Mon, 16 Oct 2023 15:37:54 +0000

Great bit of streisand effect advertising to look into getting an Apple Card savings account. Too bad it's not available in europe.

New comment by naillo in "Takeaways from hundreds of LLM finetuning experiments with LoRA"

naillo — Fri, 13 Oct 2023 15:56:41 +0000

Good article but my god why is there like a 2 second delay before every user interaction on this page. Scrolling, selecting text, everything has some kind of 2 second 'bootup' time after which things work normally but if you stop interacting with it for a bit it goes back to some idle mode. Really weird.

New comment by naillo in "Safe AI Image Generation"

naillo — Mon, 09 Oct 2023 15:54:32 +0000

I think it's just them being scared of models running on their servers producing things that cause bad PR. And the reason they're not willing to not run things on their servers is competitive advantage as well as just extracting more money out of users that way. (I definitely don't think actual safety is the concern.)

New comment by naillo in "Generative AI could make search harder to trust"

naillo — Fri, 06 Oct 2023 17:35:37 +0000

Well they could just not allow prompts that seem to participate in blogspam. If they wanted to stop it they definitely could.

Their argument is that since it's centralized, things like that are possible (while with llama2 you can't), they do "patch" things all the time. But since blobspam are contributing to paying back the billions microsoft expects they're not going to.

New comment by naillo in "Generative AI could make search harder to trust"

naillo — Fri, 06 Oct 2023 09:24:36 +0000

It's funny that one argument openai used to keep their models closed and centralized is so they could prevent things like this. And yet they're doing basically nothing to stop it (and letting the web deteriorate) now that profit has come into play.

New comment by naillo in "Matrix Operations with Math.js"

naillo — Fri, 06 Oct 2023 08:38:35 +0000

New comment by naillo in "Product Strategy in the Age of AI"

naillo — Thu, 05 Oct 2023 09:15:32 +0000

This is all making me realize investors are just people with money (not these super intelligent market predictors that they're often portrayed). You'd do the same to market a product as you would to skim off the flood of money going into a hyped field I suppose.

New comment by naillo in "Running Stable Diffusion XL 1.0 in 298MB of RAM"

naillo — Tue, 03 Oct 2023 16:37:48 +0000

Watch 5 seconds of a tv show with your big tv and you've spent that environmental cost

New comment by naillo in "Running Stable Diffusion XL 1.0 in 298MB of RAM"

naillo — Tue, 03 Oct 2023 16:36:05 +0000

Calculator next

New comment by naillo in "Stable LM 3B: Bringing Sustainable, High-Performance LMs to Smart Devices"

naillo — Mon, 02 Oct 2023 18:16:56 +0000

Stability is so awesome, I love them

New comment by naillo in "Mistral releases ‘unmoderated’ chatbot via torrent"

naillo — Sat, 30 Sep 2023 13:08:31 +0000

They're amusing but they're definitely dangerous to the potential of AI in the medium term. People like to say that "these things will happen anyway" even if it's made illegal, but there's no way 250 million will be invested into a company to develop LLMs if they're made illegal or heavily regulated. ML is resource intensive as it is (in terms of number of PhDs required and compute) and if the decels and censors have their way they definitely can make a dent in progress (i.e. "it'll happen anyway" isn't true, or it'll be slowed down so much nothing interesting will happen within our lifetimes).

New comment by naillo in "Burning money on paid ads for a dev tool – what we've learned"

naillo — Fri, 29 Sep 2023 09:49:52 +0000

The importance of and consequences of not dogfooding

New comment by naillo in "Mistral 7B"

naillo — Wed, 27 Sep 2023 16:51:26 +0000

These things won't be 'all knowing': things that are kept secret by the government like how to make nuclear weapons won't be known by it, nor can you ask it what your coworker thinks of you and have it accurately tell the answer. They are however great reasoning and creative engines. I look forward to being able to boost that part of my workflow.

New comment by naillo in "Freelancers aren’t happy with Japan’s new invoice system"

naillo — Tue, 26 Sep 2023 14:16:05 +0000

10% increase, not just 10%

New comment by naillo in "My solopreneur story"

naillo — Sat, 23 Sep 2023 14:21:21 +0000

Well dalle3 pretty much has that niche covered