<rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Hacker News: eiz</title><link>https://news.ycombinator.com/user?id=eiz</link><description>Hacker News RSS</description><docs>https://hnrss.org/</docs><generator>hnrss v2.1.1</generator><lastBuildDate>Tue, 08 Sep 2026 16:40:47 +0000</lastBuildDate><atom:link href="https://hnrss.org/user?id=eiz" rel="self" type="application/rss+xml"></atom:link><item><title><![CDATA[New comment by eiz in "RedPajama: Reproduction of LLaMA with friendly license"]]></title><description><![CDATA[
<p><a href="https://arxiv.org/pdf/2302.13971.pdf" rel="nofollow">https://arxiv.org/pdf/2302.13971.pdf</a> table 15. 1770394 A100-80GB hours to train the entire model suite at the going rate for cloud 8xA100-80GBs (~$12/hr if you could actually get capacity) is ~$2.6M, under extremely optimistic assumptions. YMMV on bulk pricing ;) "the more you buy the more you save"</p>
]]></description><pubDate>Mon, 17 Apr 2023 21:08:44 +0000</pubDate><link>https://news.ycombinator.com/item?id=35606618</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=35606618</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=35606618</guid></item><item><title><![CDATA[New comment by eiz in "What are transformer models and how do they work?"]]></title><description><![CDATA[
<p>> Where is the connection between computational details and the model's high-level behavior? Do we even know?<p>This is an active area of study ("mechanistic interpretability") and it's very early days. For instance here's a paper I read recently that tries to explain how a very simple transformer learns how to do modular arithmetic: <a href="https://arxiv.org/abs/2301.05217" rel="nofollow">https://arxiv.org/abs/2301.05217</a><p>Curious what interesting results people are aware of in this area.</p>
]]></description><pubDate>Sat, 15 Apr 2023 11:13:11 +0000</pubDate><link>https://news.ycombinator.com/item?id=35579527</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=35579527</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=35579527</guid></item><item><title><![CDATA[New comment by eiz in "What are transformer models and how do they work?"]]></title><description><![CDATA[
<p>> 4. Describing positional embeddings as multiplicative. They are generally (and very counterintuitively to me, but nevertheless) additive with token embeddings.<p>Worth noting that rotary position embeddings, used in many recent architectures (LLaMA, GPT-NeoX, ...), are very similar to the original sin/cos position embedding in the transformer paper but using complex multiplication instead of addition</p>
]]></description><pubDate>Sat, 15 Apr 2023 08:43:13 +0000</pubDate><link>https://news.ycombinator.com/item?id=35578788</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=35578788</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=35578788</guid></item><item><title><![CDATA[New comment by eiz in "Anthropic’s $5B, 4-year plan to take on OpenAI"]]></title><description><![CDATA[
<p>Fair enough. In the GH100 architecture doc <a href="https://resources.nvidia.com/en-us-tensor-core/gtc22-whitepaper-hopper" rel="nofollow">https://resources.nvidia.com/en-us-tensor-core/gtc22-whitepa...</a> (page 18) they do mention retaining 2 graphics-capable TPCs but it's clearly not the focus.</p>
]]></description><pubDate>Tue, 11 Apr 2023 15:11:17 +0000</pubDate><link>https://news.ycombinator.com/item?id=35526273</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=35526273</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=35526273</guid></item><item><title><![CDATA[New comment by eiz in "Anthropic’s $5B, 4-year plan to take on OpenAI"]]></title><description><![CDATA[
<p>> They do not have any graphics rendering circuitry.<p>What? Not having a display output is not the same as not having graphics rendering circuitry. Here's vulkaninfo from an A100 box: <a href="https://gist.github.com/eiz/c1c3e1bd99341e11e8a4acdee7ae4cb4" rel="nofollow">https://gist.github.com/eiz/c1c3e1bd99341e11e8a4acdee7ae4cb4</a></p>
]]></description><pubDate>Tue, 11 Apr 2023 13:17:12 +0000</pubDate><link>https://news.ycombinator.com/item?id=35524697</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=35524697</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=35524697</guid></item><item><title><![CDATA[New comment by eiz in "The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT"]]></title><description><![CDATA[
<p>Here's a couple more quotes from Yann LeCun, their Chief AI Scientist:<p><a href="https://twitter.com/ylecun/status/1643945742850031616" rel="nofollow">https://twitter.com/ylecun/status/1643945742850031616</a><p><a href="https://twitter.com/ylecun/status/1644503237699969026" rel="nofollow">https://twitter.com/ylecun/status/1644503237699969026</a><p>pretty clear the non-release and extremely half assed response to the leak is just CYA</p>
]]></description><pubDate>Mon, 10 Apr 2023 00:55:08 +0000</pubDate><link>https://news.ycombinator.com/item?id=35508020</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=35508020</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=35508020</guid></item><item><title><![CDATA[New comment by eiz in "Building a Virtual Machine Inside ChatGPT"]]></title><description><![CDATA[
<p>I tried this:<p>> Solve the following word problem step by step:<p>> "John is in a train moving west at ten miles per hour. Jill is in a train moving north at twenty miles per hour. How fast are John and Jill moving apart from each other?"<p>To solve this problem, we first need to understand the concept of speed. Speed is a measure of distance traveled over time. In this problem, we are told that John and Jill are traveling at different speeds in different directions.<p>Since the two trains are moving in different directions, we cannot simply add or subtract their speeds to find the combined speed at which John and Jill are moving apart from each other. Instead, we need to use the Pythagorean theorem to find the combined speed.<p>The Pythagorean theorem states that in a right triangle, the square of the length of the hypotenuse (the longest side of the triangle) is equal to the sum of the squares of the lengths of the other two sides. In this problem, we can consider the trains to be moving along the two sides of a right triangle, with the distance between them as the hypotenuse.<p>We can use the Pythagorean theorem to find the distance between John and Jill as follows:<p>First, we square the speed of each train and add the results:<p>10 mph * 10 mph + 20 mph * 20 mph = 100 + 400 = 500<p>Next, we take the square root of the result to find the distance between John and Jill:<p>sqrt(500) = 22.36 mph<p>Therefore, the combined speed at which John and Jill are moving apart from each other is approximately 22.36 mph.<p>---<p>Results seem pretty inconsistent though. Other attempts have given complete nonsense.</p>
]]></description><pubDate>Sun, 04 Dec 2022 03:17:41 +0000</pubDate><link>https://news.ycombinator.com/item?id=33850230</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=33850230</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=33850230</guid></item><item><title><![CDATA[New comment by eiz in "Pet Airways"]]></title><description><![CDATA[
<p>I've done this a few times too.<p>> There’s no way to pre-register the pet.<p>At least on Delta, you can. You need to call the airline and arrange it.<p>> Oh, and to go through security, you have to take a nervous and scared cat out of their carry case in the middle of the security line, walk through the metal detector, and then they have to test both of your hands for residue while still carrying the cat.<p>I always refuse the normal line and get a private screening. So far I haven't had any issues doing that.<p>Still, it's a huge pain in the ass.</p>
]]></description><pubDate>Thu, 28 Apr 2022 23:20:51 +0000</pubDate><link>https://news.ycombinator.com/item?id=31199441</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=31199441</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=31199441</guid></item><item><title><![CDATA[Preparing for the first winter without Russian gas]]></title><description><![CDATA[
<p>Article URL: <a href="https://www.bruegel.org/2022/02/preparing-for-the-first-winter-without-russian-gas/">https://www.bruegel.org/2022/02/preparing-for-the-first-winter-without-russian-gas/</a></p>
<p>Comments URL: <a href="https://news.ycombinator.com/item?id=30510377">https://news.ycombinator.com/item?id=30510377</a></p>
<p>Points: 38</p>
<p># Comments: 6</p>
]]></description><pubDate>Tue, 01 Mar 2022 06:22:32 +0000</pubDate><link>https://www.bruegel.org/2022/02/preparing-for-the-first-winter-without-russian-gas/</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=30510377</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=30510377</guid></item><item><title><![CDATA[New comment by eiz in "K Programming Language"]]></title><description><![CDATA[
<p>> This means no closures, which K implementers consider a feature (I don't).<p>having not touched K in about 15 years, when did this change? in k3:<p><pre><code>    K 3.2 2004-09-23 Copyright (C) 1993-2004 Kx Systems
    LIN32 16CPU 15985MB ubuntu 0 EVAL  
    
      f:{a:x+1;{a+x}}
      g:f 1
      g
    {a+x}
      g 2
    4
      a
    value error
    a
    ^
    parse error</code></pre></p>
]]></description><pubDate>Sat, 11 Sep 2021 18:46:29 +0000</pubDate><link>https://news.ycombinator.com/item?id=28494662</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=28494662</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=28494662</guid></item><item><title><![CDATA[New comment by eiz in "Git is too hard"]]></title><description><![CDATA[
<p>> If you think Chat apps are winning, let me know when you can buy an item online without an account linked to an Email. I'd love to see an example.<p><a href="https://www.amazon.com/gp/help/customer/display.html?nodeId=GG3RU889NM34H3YR" rel="nofollow">https://www.amazon.com/gp/help/customer/display.html?nodeId=...</a></p>
]]></description><pubDate>Wed, 18 Nov 2020 02:47:55 +0000</pubDate><link>https://news.ycombinator.com/item?id=25132646</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=25132646</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=25132646</guid></item><item><title><![CDATA[New comment by eiz in "Ask HN: Who is hiring? (October 2020)"]]></title><description><![CDATA[
<p>We can do full (permanent) remote.</p>
]]></description><pubDate>Fri, 02 Oct 2020 02:57:46 +0000</pubDate><link>https://news.ycombinator.com/item?id=24658327</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=24658327</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=24658327</guid></item><item><title><![CDATA[New comment by eiz in "Audiophiles in Japan Are Installing Their Own Power Poles"]]></title><description><![CDATA[
<p>> It's an HDMI cable! The video signal has CRC in it and is packetized, it's either going to make it or it isn't.<p>I don't disagree with your main point, but this actually isn't quite true. The HDMI signal is split into 3 distinct interleaved periods: video data, data island and control. Video data is not packetized and the only possible error detection it has is from TMDS signaling, but no such error handling is required by the TMDS spec. You can absolutely get imperfect transmission of an HDMI video signal due to cable or other electrical problems. Auxiliary packets in the data island, including audio data, do have an error correction scheme (BCH + TERC4).<p>Feel free to check out the spec: <a href="https://glenwing.github.io/docs/HDMI-1.4b.pdf" rel="nofollow">https://glenwing.github.io/docs/HDMI-1.4b.pdf</a></p>
]]></description><pubDate>Sat, 29 Dec 2018 02:41:49 +0000</pubDate><link>https://news.ycombinator.com/item?id=18781416</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=18781416</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=18781416</guid></item><item><title><![CDATA[New comment by eiz in "Apple’s Guidelines Now Allow Executable Code in Educational Apps and Dev Tools"]]></title><description><![CDATA[
<p>Last time I checked the "free" provisioning profiles it generates are valid for something like 7 days. It's not really convenient for anything but experimenting with iOS development.</p>
]]></description><pubDate>Mon, 12 Jun 2017 13:19:28 +0000</pubDate><link>https://news.ycombinator.com/item?id=14537127</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=14537127</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=14537127</guid></item><item><title><![CDATA[New comment by eiz in "Google Fiber Was Doomed from the Start"]]></title><description><![CDATA[
<p>The calculator you linked to assumes a maximum TCP window size of 64KB for everything but "replication". TCP window scaling has been on by default in every major OS for 10 years or more, allowing much greater throughput. It's true that latency sets a limit on TCP throughput but it's not nearly as bad as your calculator would indicate.</p>
]]></description><pubDate>Wed, 15 Mar 2017 20:30:16 +0000</pubDate><link>https://news.ycombinator.com/item?id=13879486</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=13879486</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=13879486</guid></item><item><title><![CDATA[New comment by eiz in "David Bowie Has Died"]]></title><description><![CDATA[
<p>Relevant: <a href="https://www.youtube.com/watch?v=Q0-51IkWpFE" rel="nofollow">https://www.youtube.com/watch?v=Q0-51IkWpFE</a></p>
]]></description><pubDate>Mon, 11 Jan 2016 08:53:02 +0000</pubDate><link>https://news.ycombinator.com/item?id=10879643</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=10879643</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=10879643</guid></item><item><title><![CDATA[New comment by eiz in "libimobiledevice – A cross-platform library to communicate with iOS devices"]]></title><description><![CDATA[
<p>house_arrest used to allow direct access to the documents and container of any app. It's used by the Xcode "installed applications" list, to allow you to download and upload container contents. In 8.3 they changed it to only allow VendDocuments access to apps which actually have document sharing enabled in their Info.plist (and VendContainer access for ad-hoc provisioned apps, iirc).<p>Backup is done via a completely separate service.<p>iOS releases do tend to arbitrarily change the security policy of these services, but it's not clear that "Rootless" is anything more than business as usual. Guess we'll find out Monday.</p>
]]></description><pubDate>Sat, 06 Jun 2015 17:45:18 +0000</pubDate><link>https://news.ycombinator.com/item?id=9671580</link><dc:creator>eiz</dc:creator><comments>https://news.ycombinator.com/item?id=9671580</comments><guid isPermaLink="false">https://news.ycombinator.com/item?id=9671580</guid></item></channel></rss>