In the short term, the big challenge is being able to afford hardware that can run a ~30B model. Last month I got to experiment with LLMs on a NVIDIA RTX 6000 Ada Generation as a visiting researcher during my summer break. I see the power of local LLMs for agentic coding; they’re no Claude, but they are quite useful. I wish I had gotten into local LLMs before hardware has gotten prohibitively expensive and in some cases unavailable; Apple discontinued certain Mac Minis and Mac Studios with high amounts of RAM due to the RAM shortage.

Hopefully high RAM prices don’t become a new normal, though the next year or two doesn’t look good.

At least teacher housing provides a way for teachers to obtain secure housing closer to work without having to directly compete against highly-paid corporate workers with RSUs.

Hewlett-Packard under its founders believed in loyalty, and even had a philosophy dubbed The HP Way (https://en.wikipedia.org/wiki/The_HP_Way) that seem like an interesting cross between some of the positive aspects of working for a Japanese company (loyalty, sense of care by the company) and the positives of working in Silicon Valley (flexible work hours, profit sharing), plus some other ideas (Friday afternoons devoted to personal projects).

This philosophy was not commonplace even in Silicon Valley at the time; the founders lamented “hire and fire” companies in Silicon Valley. Eventually HP abandoned the HP Way once HP started hiring outsiders as CEOs instead of hiring from within, beginning with Carly Fiorina.

I feel we’re in a timeline in Silicon Valley where there’s little idealism. Employees seek money, and who can blame them when a two-bedroom apartment can easily rent for $4000/mo or more, and when a house is easily $2 million? Leaders seek not only money, but power, and their desires for power have been more blatant in the past year.

Where are the Steve Wozniak and Gary Kildall figures of Silicon Valley these days?

I went to St. Louis, Missouri on a business trip two years ago and was pleasantly shocked by the food prices there. I felt like I entered a time machine to 2016 California.

Regarding sushi in Japan, prices run the gamut from cheap conveyor-belt sushi chains (like Hama Sushi and Sushiro) and grocery/convenience store sushi (which is surprisingly good here) to ultra-expensive, reservation-only restaurants with sushi served by world-renowned chefs, and everything in between. I’m not an expert on sushi, but I find that $5 grocery store sushi in Japan often beats what costs $20 back in the Bay Area. To be fair, though, the Bay Area has many excellent sushi restaurants, and while it’s more expensive in the Bay Area than Japan for the same quality, the counterargument is a meal at a Bay Area restaurant is much cheaper than a flight to Japan. I just happen to be fortunate enough to go to Japan twice a year, so I just wait until I’m in Japan to have sushi.

Japan, on the other hand, is heaven for those with US dollars. A bowl of ramen is around ¥1,100 here (I’m here on a research visit), and they generally taste amazing! Even a Big Mac meal from McDonald’s is far cheaper than in the Bay Area.

I’m concerned about the power that Google and other Big Tech companies have, but from a technical point of view Google has a lot of impressive technologies, and from a workplace standpoint, it seemed idyllic back in the early 2010s, though I’ve heard the work culture has changed in the past decade, and I may have rose-colored glasses from only being an intern there, never a full-timer.

https://youtu.be/Fc3cW0nqAQ0

The nice thing about e-textbooks is not needing to carry around a bunch of heavy books. I remember the tomes I had in my college days, such as Stewart's Calculus.

Apple is more tasteful, IMO, but Apple also has a tendency to abuse its users, taking the attitude, "What are you going to do? Switch to Windows or Android?" Adobe has taken a similar attitude since the Creative Suite became subscription-only. "What are you going to do? The GIMP? Seriously?"

Additionally, software is often chosen based on market effects and not necessarily based on quality. If my colleagues use Zoom, then I need to use Zoom to avoid being difficult. If they use Microsoft Office and take advantage of features that LibreOffice and other competitors can’t support well, then I’m pressured to also use Microsoft Office for compatibility reasons.

The only silver lining I see is that these price hikes will effectively freeze current software requirements in the near future, since purchasing power has been diminished. The MacBook Neo has set 8GB of RAM as the standard for casual users. I’ve found that I don’t have a good time on Windows 11 with 8GB of RAM, but 16GB provides more breathing room and 32GB is great. I don’t expect software companies to revert to the days where they needed to squeeze every kilobyte of RAM like back in the 80s and 90s, but I do expect them to be more mindful of the fact that a lot of people will be using 8GB and 16GB configurations through at least the end of the decade.

https://lowendmac.com/1999/power-mac-g4-yikes/

I have a 350MHz model that I purchased used for $40 back in 2009.

I’ve never seen across-the-board price hikes from Apple that were not accompanied with some type of upgrade.

I have some choice words for Sam Altman for destroying the personal computing marketplace by cornering the memory market…