Hacker News: crazypython

New comment by crazypython in "Entropy, a CLI that scans files to find high entropy lines (might be secrets)"

crazypython — Wed, 05 Jun 2024 07:58:09 +0000

It would be interesting to see a variant of this that used a small language model to measure entropy.

New comment by crazypython in "Ask HN: What is the current (Apr. 2024) gold standard of running an LLM locally?"

crazypython — Mon, 01 Apr 2024 12:20:15 +0000

It lacks batching support (n>1), unfortunately, which is necessary for Loom-like applications

New comment by crazypython in "Overview: What are Cpp2 and cppfront? How do I get and build cppfront?"

crazypython — Sun, 31 Mar 2024 22:26:26 +0000

What are the tradeoffs between cpp2 and Carbon?

New comment by crazypython in "Searx is no longer maintained"

crazypython — Fri, 08 Sep 2023 00:11:46 +0000

https://Kagi.com and https://metaphor.systems have been doing a great job for me

New comment by crazypython in "Non-determinism in GPT-4 is caused by Sparse MoE"

crazypython — Fri, 04 Aug 2023 23:36:13 +0000

The GPT-3.0 "davinci-instruct-beta" models have been returning non-deterministic logprobs as early as early 2021. This is speculation. CUDA itself often has nondeterminism bugs.

text-davinci-001 and text-davinci-002 were trained through FeedMe and SFT, while text-davinci-003 was RLHF; the models themselves have more variance at high temperature.

New comment by crazypython in "Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM"

crazypython — Tue, 06 Jun 2023 14:54:32 +0000

"™" has no legal meaning. "(R)" means a registered trademark.

New comment by crazypython in "The NixOS Foundation’s Call to Action: S3 Costs Require Community Support"

crazypython — Sat, 03 Jun 2023 06:35:52 +0000

S3 is a highly reliable storage media. You should use a CDN that transparently caches S3 artifacts to save on reads, such as AWS CloudFront or Cloudflare R2 are good choices.

New comment by crazypython in "OpenAI ChatGPT: Optimizing language models for dialogue"

crazypython — Thu, 01 Dec 2022 01:03:10 +0000

How did you come up with the long-term memory idea?

New comment by crazypython in "Stable Diffusion Public Release"

crazypython — Tue, 23 Aug 2022 01:22:14 +0000

Setting norms of asking folks not to abuse it reduces the likelihood people will step out of line with those norms.

New comment by crazypython in "Prometheus: Fuel from the Air"

crazypython — Tue, 16 Aug 2022 22:14:19 +0000

Definitely worth getting excited about, though it seems the current cost of fuel production as of Aug 8 including crude oil cost is $3.40/gal minus taxes and distribution.[0] Prometheus will likely cost less to distribute, since it doesn't need to be shipped across seas, funneled through pipelines, and between refineries, it can be produced next to solar or wind generation.

For reference, Prometheus costs $1.86/gal to operate and they are aiming to reduce the cost of the machine so it can be produced including capex at $3.00/gal.

[0]: https://www.energy.ca.gov/data-reports/energy-almanac/transp...

New comment by crazypython in "Hacker FAQ"

crazypython — Sun, 26 Jun 2022 19:00:09 +0000

> More generally, a job that requires fast and unexpected changes, significant skill, and is not very repetitive will be one a hacker will excel at. Repetitive, simple jobs are a waste of a good hacker, and will make your hacker bored and frustrated. No one works well bored and frustrated.

> The good news is, if you get a hacker on something he particularly likes, you will frequently see performance on the order of five to ten times what a "normal" worker would produce.

Hacker FAQ

crazypython — Sun, 26 Jun 2022 18:58:59 +0000

Article URL: https://www.seebs.net/faqs/hacker.html

Comments URL: https://news.ycombinator.com/item?id=31886823

Points: 1

# Comments: 0

New comment by crazypython in "OPT: Open Pre-trained Transformer Language Models"

crazypython — Tue, 03 May 2022 03:06:57 +0000

BigScience (a coalition including Huggingface) is training and releasing a 175B language model and finishes in 2 month.

Textsynth: Bellard's free GPT-NeoX-20B, GPT-J playground and paid API

crazypython — Wed, 27 Apr 2022 01:42:45 +0000

Article URL: https://textsynth.com/playground.html

Comments URL: https://news.ycombinator.com/item?id=31175291

Points: 263

# Comments: 134

New comment by crazypython in "Twitter set to accept Musk's $43B offer – sources"

crazypython — Mon, 25 Apr 2022 17:39:40 +0000

I don't receive them on my main account. I do receive them on a less active alt.

New comment by crazypython in "Ask HN: What's the most stable form of digital storage?"

crazypython — Mon, 25 Apr 2022 07:29:43 +0000

Or microfiche, tiny paper.

New comment by crazypython in "In defense of swap: common misconceptions (2018)"

crazypython — Thu, 21 Apr 2022 07:51:48 +0000

I agree with this post, though there's another factor to consider: SSD endurance. A system that swaps a lot will write more, decreasing endurance. You might need to buy a new SSD every 5 years.

Is it ever a good thing to use a nonfree program?

crazypython — Wed, 20 Apr 2022 22:26:21 +0000

Article URL: https://www.gnu.org/philosophy/is-ever-good-use-nonfree-program.html

Comments URL: https://news.ycombinator.com/item?id=31103880

Points: 4

# Comments: 1

New comment by crazypython in "Richard Stallman – The state of the Free Software movement"

crazypython — Mon, 18 Apr 2022 08:46:14 +0000

under the free software philosophy (free SOFTWARE), art assets are allowed to be non-free, but stallman believes the game code itself should be free. considering games rely heavily on art, this model still lets you sell games.

Stallman isn't a free culture person

New comment by crazypython in "Assume your devices are compromised"

crazypython — Mon, 18 Apr 2022 08:43:04 +0000

I use a separate user account for games.