Hacker News: mistymountains

New comment by mistymountains in "We fine-tuned Llama 405B on AMD GPUs"

mistymountains — Tue, 24 Sep 2024 01:30:09 +0000

Again, the problem is custom kernels in CUDA. It’s not straightforward for many applications (LLMs are probably the most straightforward).

New comment by mistymountains in "Venting Doesn't Reduce Anger, but Something Else Does, Study Says"

mistymountains — Tue, 06 Aug 2024 13:32:27 +0000

It doesn’t sound like having a house will magically make you feel better. Plenty of people are just as exposed to markets as you yet respond differently. I suggest exercise, nutrition, nature, and extended travel if those are not already a part of your life.

New comment by mistymountains in "AMD's MI300X Outperforms Nvidia's H100 for LLM Inference"

mistymountains — Thu, 13 Jun 2024 15:25:18 +0000

These kinds of comments make me think few people have actually tried. My experience has been 1 work day of getting things set up to work the same as before for training and testing (PyTorch).

New comment by mistymountains in "AMD's MI300X Outperforms Nvidia's H100 for LLM Inference"

mistymountains — Thu, 13 Jun 2024 15:23:24 +0000

Unless you develop in CUDA, you can easily train code (e.g. PyTorch) written for training on Nvidia hardware on AMD hardware. You can even keep the .cuda() calls.

New comment by mistymountains in "AMD's MI300X Outperforms Nvidia's H100 for LLM Inference"

mistymountains — Thu, 13 Jun 2024 15:21:26 +0000

I’m a AI Scientist and train a lot of models. Personally I think AMD is undervalued relative to Nvidia. No, chips aren’t as fast as Nvidia’s latest and yes, there are some hoops to get things working. But for most workloads in most industries (ignoring for the moment that AI is likely a poor use of capital), it will be much more cost effective and achieve about the same results.

New comment by mistymountains in "Tesla cuts even more workers as unsold inventory stacks up"

mistymountains — Mon, 06 May 2024 20:56:17 +0000

Why would you want (versus need) a Tesla? It’s no longer an aspirational product, it’s an appliance.

New comment by mistymountains in "How to Study (2023)"

mistymountains — Sun, 11 Feb 2024 17:06:34 +0000

For all you know he had a hard adjustment to the college workload. Maybe his high school was not serious and nobody really challenged him. You all could have interrogated why he may have struggled and shared your strategies for success, lifting him up rather than beating him down. That would make you true “brothers”.

New comment by mistymountains in "What it was like working for Gitlab"

mistymountains — Sun, 11 Feb 2024 16:55:17 +0000

My (biotech, mostly remote) company does this. They may not love it but they realize they have to hire from SF, Boston, NYC etc to get the best ML talent and people expect market salaries / don’t want to up and move if they don’t have to.

New comment by mistymountains in "MBAs who can't find jobs"

mistymountains — Wed, 17 Jan 2024 05:38:05 +0000

The issue is that actually, outside of technical paths, businesses do like to hire business grads as it allows them to do even less training and they usually don’t care if someone is well read or opinionated (possibly prefer the opposite).

New comment by mistymountains in "The GPT Store"

mistymountains — Thu, 11 Jan 2024 02:11:16 +0000

Or, just maybe, AGI is a mirage with the bulk of its current utility as a marketing tool for much more realistic, if ultimately mundane, applications. OpenAI, of course, knows this.

New comment by mistymountains in "Mamba: Linear-Time Sequence Modeling with Selective State Spaces"

mistymountains — Tue, 05 Dec 2023 16:35:42 +0000

You won’t teach yourself by running papers through Claude, and you won’t need to if you went from first principles rather than rushing.

New comment by mistymountains in "WiFi without internet on a Southwest flight"

mistymountains — Sat, 30 Sep 2023 16:41:30 +0000

You gave your 9 year old a smartphone?

New comment by mistymountains in "Volvo to cease production of diesel cars in a few months"

mistymountains — Fri, 22 Sep 2023 16:13:23 +0000

It’s annoying how much things have shifted now that you can’t really own a performance car without worrying if someone will mess with it.

New comment by mistymountains in "TikTok proposes giving US govt control over moderation, software, security"

mistymountains — Fri, 22 Sep 2023 15:55:13 +0000

Yeah we all need to do better and trust China more! Lol.

New comment by mistymountains in "A Texas semiconductor boom on the horizon?"

mistymountains — Sun, 10 Sep 2023 20:57:50 +0000

Is this your diagnosis? That things are more corporate in terms of outcome? Genuinely curious, as a Bay Area native, why UT/Texas can’t begin to compete given how many issues face SF currently.

New comment by mistymountains in "Running a 180B parameter LLM on a single Apple M2 Ultra"

mistymountains — Fri, 08 Sep 2023 05:55:20 +0000

Cool it with the italics.

New comment by mistymountains in "X/Twitter has updated its terms of service to let it use posts for AI training"

mistymountains — Fri, 01 Sep 2023 17:57:13 +0000

Comment datasets are valuable for conversational AI, it’s the same reason Reddit locked down the API I imagine.

New comment by mistymountains in "DMV tells Cruise to reduce its driverless vehicle fleet in SF by 50%"

mistymountains — Sat, 19 Aug 2023 16:52:26 +0000

It’s probably the best from their training standpoint. The city is quite small relative to others and their only hope is to essentially memorize San Francisco in the neural networks. IMO you could not take a cruise and drop it into any other city and have it work.

New comment by mistymountains in "DMV tells Cruise to reduce its driverless vehicle fleet in SF by 50%"

mistymountains — Sat, 19 Aug 2023 16:50:59 +0000

They’re too deep, their networks are overfit to San Francisco at this point. Making it work in other cities would require the insane training hours to basically memorize that city.

New comment by mistymountains in "Ask HN: Is GPT 4's quality lately worst than GPT 3.5?"

mistymountains — Wed, 02 Aug 2023 02:57:18 +0000

I’ve seen this stated a ton and it’s not really true. Once trained, the model (except for decoding) is deterministic, and you can enforce determinism fairly easily. ChatGPT is not deterministic at the chat window but that’s not inherent to the model.