They’re saying basically that NoSQL DBs solve a lot of horizontal scaling problems but aren’t a good fit for their highly relational data, is my understanding. Not that they can’t get NoSQL functionality at eg the query level in relational DBs.

The external spanner documentation doesn’t seem as good as the internal documentation, in my opinion. Because it’s not generally well known outside of G, they ought to do a better job explaining it and its benefits. It truly is magical technology but you have to be a database nerd to see why.

It’s also pretty expensive and because you generally need to rewrite your applications to work with it, there is a degree of lockin. So taking on Spanner is a risky proposition - if your prices get hiked or it starts costing more than you want, you’ll have to spend even more time and money migrating off it. Spanner’s advantages over other DBs (trying to “solve” the CAP theorem) then become a curse, because it’s hard to find any other DB that gives you horizontal scaling, ACID, and high availability out of the box, and you might have to solve those problems yourself/redesign the rest of your system.

Personally I would consider using Cloud Spanner, but I wouldn’t bet my business on it.

With some of these models the guardrails are so clumsy and forced that I think almost any typical user will notice them. Because they include outright work-refusal it’s a very frustrating UX to have to “discover” the policy for yourself through trial and error.

And because they’re more about brand management than preventing fraud/bad UX for other users, the failure modes are “someone deliberately engineered a way to get objectionable content generated in spite of our policies.” Obviously some kinds of content are objectionable enough for this to be worth it still, but those are mostly in the porn area - if somebody figures out a way to generate an image that’s just not PC, despite all the safety features, shouldn’t that be on them rather than the provider?

Even tuning the model for political correctness is not the end of the world in my opinion, a lot of LLMs do a perfectly reasonable job for my regular use cases. With image generators they are going so far as to obviously (there’s no other way that makes sense) insert diversity sub prompts for some fraction of images which is simply confusing and amateur. Everybody who uses these products just a little bit will notice it. It’s also so cautious that even mild stuff (I tried to do the “now make it even more X” with “American” and it stopped at one iteration) gets caught in the filters. You’re going to find out the policies anyway because they’re so broad an likely to be encountered while using the product innocently - anything a real non-malicious user is likely to get blocked by should be documented.

It’s very easy to get into the habit of extremely high caffeine intake, speaking from experience. Not only is caffeine in many drinks and extremely well distributed, its psychological effects are pretty mild. But I think the worst part is that people don’t really think about how much caffeine is in the coffee they’re drinking because it’s hard to measure.

People choose to use push models for content through meta properties, tiktok, and aggregators like reddit and HN, but nothing is forcing them to. If they push enough bad content, people won't keep using them. Already happened with Facebook and Reddit predecessors, probably happening to Reddit now.

It doesn't matter how big the haystack is when you have the ability to go directly to the needle.

It's a lazy argument to imply this 1. invalidates the technological achievement 2. prevents iterative improvement a la the singularity. For one, the Internet itself is not bullshit just because a lot of spammers/hustlers put bad content on it to try to make money. And secondly, you can curate datasets... nothings stopping researchers from training LLMs on shitty SEO now, and if they wanted to they could curate datasets going forward to try to prevent LLM-spam from entering the training sets of future models.

And finally, people already use reputation/identity/branding and proxies for it as quality filters on the internet. For example, this is an unfamiliar blogger to me and so I entered it with skepticism I wouldn't have with people like Gwern or Lynn Alden. Good writing from people like Gwern and Lynn Alden won't disappear just because LLM content exists on the internet - it just makes reputations and identity (eg to a real human) more important.

I think in many cases it boils down to some subtype not being identified and evaluated on its own. As in your case it's especially impactful, and yet IME also usually where these kinds of things get improperly prioritized, when it's a user's first impression or when it occurs in a way that causes a user to have to just sit and wait on the other end as these are often "special" cases with different logic in your application code.

OTOH sometimes users try to weird/wrong/adversarial shit and so their high failure rate is working as intended. But it pollutes your stats such that it can hide real issues with similar symptoms and skew distributions.

I’m in the infancy of a bootstrapped company while witnessing the general enshittification of all these formerly treated VC backed companies as they prepare for /adjust to being public companies. I also recall many decent products like Quora (yes there was a period where it was actually good) go to shit and fail chasing $$. I feel like the culture is shifting for new founders and a lot us want to aim for sustainable businesses that deliver real value rather than VC moonshots that say yes to everything that makes them more money.

I think “lifestyle” business carries negative connotations and bootstrapping/roof shots don’t capture this mindset yet. For me personally I guess it’s like, I’d rather have a $100m business that does cool shit and is focused on doing one thing, than be forced into chasing growth at all costs in all directions to get a potentially much bigger exit. If I had such an exit I’d draw it down at a sustainable rate anyway that ends up not being different from the earnings of a private company of similar value.

I guess with similar luck and results maybe I could be a billionaire instead of a hundred millionaire, but idk if that really matters, and I’d then get the typical SV meaningless ennui while being glad to leave the shitshow I created before it got even shitter. Running something I’m proud of for the long term seems like a more meaningful and rewarding way to spend my time and it can actually make the world better even if it doesn’t capture as much of that value.

Like, what if the dominant social media company had refused to serve ads and optimize for watch time? What if major cloud providers had a cohesive vision instead of cobbling together every stupid thing a $100mm spend customer wanted? What if YouTube could serve recommendations based on similarity/enjoyment? They could still be major successful companies. But selling your company, taking on investors, and maybe even lending against your equity threatens to destroy that.

News media is in direct competition with big tech companies for advertising. The more eyeballs go towards big tech and not news companies, the less market share and relevancy they have.

Even worse for them, when people want news now they generally go to aggregators, search for it on Google, or get it served up by a Meta property. It used to be that instead people would read the newspaper or go to a news channel on TV. So news media is furious that big tech controls their top of funnel and distribution channels, as consumers typically prefer it that way vs directly seeking out news by going to cnn.com. In some places they’ve pushed link taxes which tech companies strongly criticized for entirely legit reasons/threatened to pull services, which upped the animosity.

Also, because news is monetized through advertising they need stories and narratives that capture people’s interests and attention. Nobody would care about a story like “Google Scholar revolutionized research discovery and accessibility and improved geographical collaboration a billion %” or “Waymo actually works pretty well no complaints” or “most SF residents actually like Waymo”. But controversy like “Waymo ran into something” is more attention grabbing the more they spin it as evil. Additionally, “good thing continues to be good” is not news but “good thing is actually bad” and “recognizable company X did a bad thing” are news. Similarly “fall from grace” “David vs Goliath” and “these people made a lot of money so you should blame them for not having money” are consistently popular narratives people like.

So news media have literally every reason to drag big tech through the mud and pretty much no reason to ever say anything good about them. For sure these companies have problems but you don’t hear about the good things (IMO Meta has made huge improvements in organizational/data security, and their products drive a lot of commerce in developing countries; Amazon warehouses are usually in places where $15-20/hr is actually a huge step up for local inhabitants; big tech is much better than Microsoft and other old school players at fighting unreasonable law enforcement requests) and the bad things are often overplayed/slanted.

A low-trust authoritarian state that restricts personal freedoms has to use heavy handed policing/secret policing with severe punishments to maintain that system. Without heavy policing the state would probably collapse internally.

A regular place needs policing to prevent the kinds of crimes we consider unambiguously bad like murder, theft, rape. Like I mentioned elsewhere trust/cooperation is game theoretical, and I think that shows up in our genes such that there are always some latent number of people predisposed to antisocial behavior. So you always need that.

But in the second case, the level of trust does reflect how much policing you need. If there is not much crime you don’t need that many police. You probably do always need some but the real world demonstrates that some places just have more criminality (low trust) and require more police.

I think Trust is not really one singular thing either, and it kind of falls apart when you look at places like China or Japan. For example in Japan people don’t generally fear petty theft of bikes or electronics, but they have women-only train cars and the government forces smartphone cameras to make a sound to prevent creepshots. In China you have the zero-sum “it is good for me when others fail” mentality but also Guanxi and genuine patriotism.

Probably technology and law enforcement does allow large scale societies to persist with extremely low trust, but the more concentrated power becomes, the more that state’s continuance is subject to the whims of a small number of people that could either change their mind (like Gorbachev) or fuck things up so badly that they get overthrown (Romania). I think it helps that leaders and police/secret-police also live within that broader low-trust society and so they do have some incentive to not make it too bad.

From the game theory perspective, a high trust society makes it easy for bad actors to abuse that trust for personal gain, which at large scale lowers trust at the societal level. A low trust society incentivizes people to build subcommunities of higher trust to get things done (which can grow to encompass lots of society) or can be outcompeted by a higher trust society, as you say. Maybe this is all covered in that book.

Clearly there is enough variance to say that societies do not all gravitate towards a fixed equilibrium though. I think a lot of this is due to institutions (eg religion, government, educational systems, militaries) and cultural factors (some cultures value cunning and ruthlessness, others conformity, etc. which can be influenced even by language or the physical environment). Many edgy internet commenters seem to equate low/high trust with race and ethnicity, but if you have ever been in a well run technology company or the US military, or a low-trust homogenous society, you’ll see this obviously wrong.

What I’ve been thinking about a lot lately while I bootstrap is whether it’s possible for a group to be resilient to “selfish” bad actors by making cooperation strictly more optimal than defection. At small scales I think this can be accomplished through a BDFL but I’m really interested in figuring out if another approach can scale into the ~thousands.

But this is rather rare and most companies have a soft ceiling for growth internally. At Google for example, for years they have been filling most Director positions externally, and so most employees find it very hard to get there and progress past that. Progression is also often subject to norms that make the sheer number of promotions required to make it high up in the company impossible.

Gemini advanced says it’s the latter, because of color confinement. But I’d defer to a human expert

I have read that one consequence of the Japanese practice of tearing down buildings and buying new is that you tend to get colocated with many people of the same socioeconomic class and age. We have similar forces going on in the Western world (families may prefer suburbs which also tend to sort by SES, yuppies prefer nice urban areas, etc) but I think in Japan it is a bit more deliberate.