Hacker News: cocogoatmain

New comment by cocogoatmain in "OpenAI declares 'code red' as Google catches up in AI race"

cocogoatmain — Wed, 03 Dec 2025 00:15:41 +0000

Want to also add that the model doesn’t know how to respond in a user-> assistant style conversation after it’s pretraining, and it’s a pure text predictor (look at the open source base models)

There’s also what is being called mid-training where the model is trained on high(er) quality traces and acts as a bridge between pre and post training

New comment by cocogoatmain in "Grok 4.1"

cocogoatmain — Tue, 18 Nov 2025 08:11:35 +0000

Provided you had the GPU compute to do so you could train the model to have less refusals, e.g. https://arxiv.org/abs/2407.01376

Quality of response/model performance may change though

There’s also nous research’s Hermes’ series of models, but those are trained on llama3.3 architecture and considered outdated now

New comment by cocogoatmain in "Nvidia DGX Spark: great hardware, early days for the ecosystem"

cocogoatmain — Wed, 15 Oct 2025 07:30:31 +0000

128gb unified memory is enough for pretty good models, but honestly for the price of this it is better just go go with a few 3090s or a Mac due to memory bandwidth limitations of this card

New comment by cocogoatmain in "Sora, AI Bicycles, and Meta Disruption"

cocogoatmain — Wed, 08 Oct 2025 23:42:02 +0000

I don’t know about the “why” but Alibaba is definitely paying to train open weight models (https://huggingface.co/Wan-AI)

New comment by cocogoatmain in "The best YouTube downloaders, and how Google silenced the press"

cocogoatmain — Sat, 20 Sep 2025 06:07:02 +0000

~~Likely much less than .25/m if that’s mbps. The issue is you’d have no shortage of money at that scale - I run one of the two main Arch Linux package mirrors in my country and while it’s admittedly a quite niche and small distro in comparison, I’m nowhere close enough to saturate 1gbit on normal days, let alone my 10gbit link~~

It’s a trade off I suppose - you can very well host your own streaming solution, and for the same price you can get a great single node, but if you want good TTFB and nodes with close proximity to many regions you may as well pay for a managed solution as the price for multiple VPS/VM stacks up quickly when you have a low budget

Edit: I think I missed your point about bandwidth pricing lol, but the second still stands

New comment by cocogoatmain in "Not paying with cash"

cocogoatmain — Thu, 04 Sep 2025 02:20:17 +0000

Assuming you’re a tourist, are you sure it’s not your bank flagging the transaction? When visiting in April I too thought it was an issue with the card when trying to reload on apple wallet, but after two cards declined, found out the transaction was flagged haha

Same experience with reloading on the physical machines. It’s quite amusing

New comment by cocogoatmain in "Wildthing – A model trained on role-reversed ChatGPT conversations"

cocogoatmain — Sun, 24 Aug 2025 06:48:06 +0000

Not the original poster but there are some large publicly available dataset such as

https://huggingface.co/datasets/allenai/WildChat

and

https://huggingface.co/datasets/lmsys/lmsys-chat-1m