Hacker News: nikkindev

New comment by nikkindev in "Using uv as your shebang line"

nikkindev — Tue, 28 Jan 2025 18:45:18 +0000

“Lazy self-installing Python scripts with uv”[1] article from Trey Hunner has more details with examples

[1] https://treyhunner.com/2024/12/lazy-self-installing-python-s...

New comment by nikkindev in "Entropy of a Large Language Model output"

nikkindev — Tue, 14 Jan 2025 07:54:59 +0000

Author here: Wholeheartedly agree with your comment on hallucination. I initially set out to answer the question “Will entropy help identify hallucination?” And soon realised that it doesn’t, for the same reasons you mentioned above. So I pivoted to just writing about the entropy measure in the post. And this is also reflected by how I started with hallucination and then quickly veered away from it. I’ll be more careful in future posts & conversations. Thanks!

New comment by nikkindev in "Entropy of a Large Language Model output"

nikkindev — Mon, 13 Jan 2025 18:52:17 +0000

Author here: Thanks for the explanation. Intuitively it does make sense that anything done during "post-training" (RLHF in our case) to make the model adhere to certain (set of) characteristics would bring the entropy down.

It is indeed alarming that the future 'base' models would start with more flattened logits as the de-facto. I personally believe that once this enshittification is recognised widely (could already be the case, but not recognized) then the training data being more "original" will become more important. And the cycle repeats! Or I wonder if there is a better post-training method that would still withhold the "creativity"?

Thanks for the RLHF explanation in terms of BPE. Definitely easier to grasp the concept this way!

New comment by nikkindev in "Entropy of a Large Language Model output"

nikkindev — Mon, 13 Jan 2025 18:21:49 +0000

Author here: Really interesting work. Updated original post to include link to the paper. Thanks!

New comment by nikkindev in "Entropy of a Large Language Model output"

nikkindev — Mon, 13 Jan 2025 18:08:09 +0000

Author here: Yes. You are right. I was meaning to paint a picture that instead of the next token appearing magically, it is sampled from a probability distribution. The notion of determinism could be explained differently. Thanks for pointing it out!

New comment by nikkindev in "Show HN: I built Wuf, mobile notifications for all your needs"

nikkindev — Tue, 12 Sep 2023 13:43:15 +0000

Not for self hosting. Self hosting [1] is still free since the code is open source.

[1] https://ntfy.sh/install/