https://modernaicourse.org/

I then discovered what quantization is by reading a blog post about binary quantization. That seemed too good to be true. I asked Claude to design an analysis assessing the fidelity of 1, 2, 4, and 8 bit quantization. Claude did a good job, downloading 10,000 embeddings from a public source and computing a similarity score and correlation coefficient for each level of quantization against the float32 SoT. 1 and 2 bit quantizations were about 90% similar and 8 bit quantization was lossless given the precision Claude used to display the results. 4 bit was interesting as it was 99% similar (almost lossless) yet half the size of 8 bit. It seemed like the sweet spot.

This analysis took me all of an hour so I thought, "That's cool but is it real?" It's gratifying to see that 4 bit quantization is actually being used by professionals in this field.

The fallacy of reification is treating something emergent as a thing-unto-itself rather than a process or interaction born from constituents at a lower stratum. A reified thing can be recognized and changed for this reason. A mental concept needs only a change of mind to mutate, or to be destroyed.

Religion may well prove to be a reification that is destroyed once it is recognized as such. But I do believe that you cannot reduce that which is real and not real to only those things that have physical antecedents at lower strata, as we see emergent phenomena in the physical world as well.

I think humans are stuck on earth permanently because there are no other environments in the solar system we can live in as easily as earth. Traditional sci-fi explained this away using overpopulation pressures, but overpopulation is fading as a reality and plausible narrative device. And forget about interstellar travel, it's too dangerous and takes too long.

If intelligent DNA-based life is still around on earth when it starts getting too hot because of the sun's expansion and it all needs to flee, it will have continued to evolve such that it will be unrecognizable and unrelatable to us. And by then I expect artificial life to have spread to such an extent that biological life on earth is basically a historical footnote.

I actually think life in the broadest sense will spread from earth to other places in the galaxy, but it will be completely alien compared to human life.

I do understand how they can stabilize allocations where they are, which I think is the concern. Zombification rather than a positive feedback loop.

Trying to beat the market is playing a zero sum game. Someone has to lose for you to win. I understand savvy winners add information, but most winners are just lucky and it still makes me uneasy to play a zero sum game.

When you simply try to match the market, you float on the tide that mostly raises all boats and sometimes lowers them. That sits much better with me.

I'm sad to report that renting a family bedroom or two joined bedrooms on Amtrak to take a journey on say the California Zephyr didn't pencil out. It is costlier than flying (about $2000 vs $1600 at the low end for both options, resp.) Even if you account for the cost of staying two extra nights at the destination it about breaks even.

With children I don't want to risk the days of travel becoming an ordeal as opposed to hours of flight time. The "digital detox" might quickly go sideways and require hours of screentime pacifiers. Maybe when they are older.

Happily the QM2 actually made financial sense and there would be more room to move about and explore the ship.

I think rail travel makes the most sense in the Acela context the article opened with - routes between cities that take less than a day. For cross-continent travel the time savings of air travel make rail travel a harder case to argue.

If by FIRE you mean retire in your 50s, I don't think that's an aspiration. That should be an expectation. You might be able to work a full career in this industry, but I wouldn't plan on it.

https://wccftech.com/ai-capex-might-equal-2-percent-of-us-gd...

> Next, Kedrosky bestows a 2x multiplier to this imputed AI CapEx level, which equates to a $624 billion positive impact on the US GDP. Based on an estimated US GDP figure of $30 trillion, AI CapEx is expected to amount to 2.08 percent of the US GDP!

Do note that peak spending on rail roads eventually amounted to ~20 percent of the US GDP in the 19th century. This means that the ongoing AI CapEx boom has lots of legroom to run before it reaches parity with the rail road boom of that bygone era.

The worst advice was that writing software, after the dotcom bust, was dead as a career. This taught me a lot about the value of "conventional wisdom" vs looking at the underlying supply and demand dynamics of a career. Sort of adjacent to the theme of the essay, I think the best careers are those that you can tolerate and those that have favorable supply-demand curves.

The best advice was from a pre-med advisor, who asked me if I wanted to spend the rest of my life surrounded by people who were old, sick, dying, and - not in so many words - decrepit. At that moment I realized I was not a healer, I found most bodies to be gross, and I had no business considering a medical career.

I would also push back on the notion that owner-operators are in a better position. It's more accurate to say that farmers who have assets of any kind are better off than those who don't have assets. As an example, generations back in my family we owned a lot of farmland. There were some bad investments made in the farming operation and we almost lost it all. This was in the early 1980s for those who are familiar.

If my grandfather had sold all of his land and equipment in the late 1970s and invested it in the recently-started Vanguard group, rather than re-investing in the farming operation, then my family would be wealthy. Now expecting a farmer to know about index investing and to bet on it when it was just starting is unreasonable. But it's a good lesson in diversification.

When people lionize farming owner-operators, they discount the risk that owner is taking by having so many assets concentrated in one operation. Now farmers do know about investing and diversification, and some do make the rational decision to cash out. Many also don't, for various reasons.

But it's not totally fair to expect farmers to behave differently than other asset owners because farming is seen romantically or in terms of national security.

This is a different argument than one which would decry the position of tenant farmers. Obviously being a tenant farmer owning nothing but equipment is harder than being a farmer who has $5 million invested somewhere else and rents the land he farms.

Psychosis can also be caused by a lack of sleep (like not sleeping for days) and in this case sleep can end the psychosis.

Which is to say that schizophrenia and psychosis have an intersecting relationship.

I think it is possible to be diagnosed with both schizophrenia and autism which is why the theory is not considered anymore.

> All participants were right-handed native English speakers with no exposure to a second natural language before the age of 6 years

Which removes a confounder that Python mimics English syntax.

Still if this is a typical study recruiting thirty-some undergrads as subjects it's probably not generalizable, or even replicable given the same experimental setup.