Hacker News: remontoire

New comment by remontoire in "A decoder-only foundation model for time-series forecasting"

remontoire — Sat, 03 Feb 2024 03:50:55 +0000

Probably drawing an analogy to how causal pretrained models go through stages of understanding language, words -> grammar -> meaning. Gwen mentions this experience when training character level RNNs. https://gwern.net/scaling-hypothesis#why-does-pretraining-wo...

New comment by remontoire in "Is parallel programming hard, and, if so, what can you do about it?"

remontoire — Wed, 14 Jun 2023 11:49:20 +0000

Watching geohot code a general matrix multiply algorithm from 0.9 GFLOPS and optimising it to 100 glops by only tinkering with cache locality, it makes me wonder how much effort should be put into single threaded performance before ever thinking about multi threading

New comment by remontoire in "What are transformer models and how do they work?"

remontoire — Sat, 15 Apr 2023 13:23:22 +0000

I think it's because you want to be able to predict the next token using only 1 token or the whole context window (and any size inbetween). So, you end up getting n different losses for each text snippet (where n is the size of the context window).

If i'm wrong, can someone correct here, would be useful to know.

New comment by remontoire in "Car wars: Analyst predicts GM, Ford will surpass Tesla EV sales by 2025"

remontoire — Fri, 01 Jul 2022 00:18:34 +0000

So the reason he thinks this is because GM and ford have announced more "models".

At no point has the limiting factor been the number of models. The limiting factor is and will be battery cell supply.

This article makes no mention of legacy OEMs making any attempt at solving their supply constraints.

New comment by remontoire in "Differences with other Lisps"

remontoire — Wed, 03 Nov 2021 08:29:59 +0000

It looks like you're right for the most part. Literals are supported if you use https://github.com/vseloved/rutils. If your cl-edn actually works then a combo of rutils and cl-edn could bring most of the value I found in clojure to common lisp.

New comment by remontoire in "Differences with other Lisps"

remontoire — Wed, 03 Nov 2021 05:42:10 +0000

I've used fset and cl21. The problem is that once you start using those you no longer are able to use libraries. Data structures have to be built into core.

The common lisp community has rejected reader macros for interop reasons the last time I checked (in the case of cl21)

Even the docs for fset doesn't show the use of data literals. it does things like (set) and (isetq s2 (set 'c 1 "foo" 'a 'c))

This pretty much proves my point. it's not fun typing (set 'c 1 "foo" 'a 'c) instead of #{'c 1 "foo" 'a 'c}. It's also not possible to put those on the wire (easily) for communication between common lisp processes. Breaking the whole point of homoiconicity.

New comment by remontoire in "Differences with other Lisps"

remontoire — Wed, 03 Nov 2021 02:48:49 +0000

> There is more to collections than lists. You can have instances of empty collections, some of which have literal support ([], {}, and ()). Thus there can be no sentinel empty collection value.

Probably my favorite feature over common lisp. Combined with comma (,) being treated as whitespace (ie, use comma if you want to but you don't have to), makes typing out data structures in clojure a much more enjoyable process than other languages.

This ease of typing out data structures also extends to edn (clojure's version of json)

New comment by remontoire in "A solution to Newcomb's paradox"

remontoire — Mon, 20 Sep 2021 03:14:57 +0000

This is definitely not an actual solution. It's a first order solution to a non-first order problem.

New comment by remontoire in "Ivermectin for the Treatment of Covid-19: A Systematic Review and Meta-analysis"

remontoire — Thu, 02 Sep 2021 04:50:18 +0000

Do you remember what this used to say? https://www.who.int/emergencies/diseases/novel-coronavirus-2...

New comment by remontoire in "I'm reading the FT and WSJ from 100 years ago each week leading to 1929"

remontoire — Mon, 09 Aug 2021 02:54:30 +0000

You're not disagreeing with them then. You are disagreeing with the point of the quote.

New comment by remontoire in "I'm reading the FT and WSJ from 100 years ago each week leading to 1929"

remontoire — Sun, 08 Aug 2021 18:19:11 +0000

His whole comment is a quote from the movie

New comment by remontoire in "Why printers add secret tracking dots (2020)"

remontoire — Sun, 01 Aug 2021 08:17:13 +0000

I suspect that the company would get a visit from the secret service

New comment by remontoire in "A contentEditable, pasted garbage and caret placement walk into a pub"

remontoire — Sat, 24 Jul 2021 03:27:21 +0000

This argument doesn't hold anymore now that there are threading macros.

(-> ((have you written) lisp before) ?)

New comment by remontoire in "A contentEditable, pasted garbage and caret placement walk into a pub"

remontoire — Sat, 24 Jul 2021 03:23:05 +0000

Does: reset!(caret-location nil)

Make more sense to you?

Maybe you would like OO style?

(-> caret-location (reset! nil))

New comment by remontoire in "Thirty Tesla crashes linked to assisted driving system under investigation in US"

remontoire — Fri, 18 Jun 2021 10:30:50 +0000

Roll-out is standard my dude. So is testing at drag strips. Next you're going to point out that a tesla accelerating on the beach gets to 60mph in 11 seconds and therefore Elon is lying.

https://www.caranddriver.com/features/a30085446/acceleration...

https://www.motortrend.com/news/motor-trend-testing/

New comment by remontoire in "Thirty Tesla crashes linked to assisted driving system under investigation in US"

remontoire — Fri, 18 Jun 2021 09:12:09 +0000

https://www.motortrend.com/cars/tesla/model-s/2021/2022-tesl...

New comment by remontoire in "SpaceX delivers 3rd batch of Starlink satellites in two weeks"

remontoire — Mon, 15 Mar 2021 06:29:31 +0000

What an unbelievably privileged thing to say.

New comment by remontoire in "Cancer death rates rising near Fermi nuclear plant"

remontoire — Sat, 13 Mar 2021 08:31:32 +0000

https://en.wikipedia.org/wiki/Radiation_and_Public_Health_Pr...

New comment by remontoire in "I Am Bezos"

remontoire — Mon, 22 Feb 2021 09:58:00 +0000

let?

New comment by remontoire in "Tesla buys $1.5B in Bitcoin, may accept it as payment in the future"

remontoire — Mon, 08 Feb 2021 14:12:31 +0000

Pretty disappointing to see the reaction this has received in this thread.