Your impact is undeniable, and i think quite importantly very tangible and concrete to you. Very inspiring.

Without the training data and open sourcing the training code and protocol you cant reproduce the model from scratch, thats true, but because the weights and structure are free to download you can modify, inspect and make derivative works off it. Calling it an inscrutable binary blob is misleading.

I do agree that its not reproducible and its often talked about like it is.

In some ways its like most scientific research with a "methodology section", which in todays academic climate often falls quite a bit short of a detailed step-by-step to reproduce results with all the ingredients, but in principle could be used by other experts to do this again. Even without publishing the exact data, a catalogue or description of what data and how it was cleaned/processed would go a long way towards a reproducible methodology i agree.

If you used to write pytorch, i think his writing is a great level of technicality to stay on top of things. And id look to them if i ever wanted to do a bit of learning/train my own.

Id love to hear if others have resources at a similar level of technicality and detial.

My attempt at a simplification of this article on it https://sebastianraschka.com/llm-architecture-gallery/per-la... into a couple of sentences is that they are linear embeddings of the input token space projected per layer, which are then gated by the transformer outputs per layer.

This would mean that the only one set of weights for the ple path needs to be pumped across the memory bandwidth as they are the same linear weights for all layers?

Sheit, maybe im trying to simplify something that i need to look at in detail. but id love to leverage others understanding if possible

Remembering my graduate physics days im astounded that i was able to understand it, and am unable to really follow it now, as that higher math has gotten preeeety rusty.

Feynman diagrams are the attempt to loop back around and represent this field without all the math, but my experience was you have to have done the math first otherwise they are just so much arcane heiroglyphs. the wikipedia illustrates this well, where you can see a relatively clear diagram and corresponding equation, but i recall whole pages of a notebook to get one _line_ of an equation down. https://en.wikipedia.org/wiki/Quantum_electrodynamics#Feynma...

I say all of this not to suggest a clear explanation is impossible, but it sure wouldn't be easy. Love to see it though.

I humbly also submit the illustrated stories of Bronzemurder and Oilfurnace https://www.olddog.games/Oilfurnace https://www.olddog.games/Bronzemurder

and the story of Glasedcoast https://glazedcoast.neocities.org/

Love to hear of more. Even if im not actively playing, i always love a read.

Its literally a paradigm shift.

Also almost all commercial art galleries are like this, obvs for other reasons. The gallery district (google art galleries then wander those streets, chelsea is the most established) in NYC is an amazing place to spend a day wandering around seeing amazing art. my uncle who teaches art introduced me to it and i try to spread the word.

Free art for any reason is amazing.

I hope it stays very simple, and would be interested if the author or anyone else can speak to what kind of complexity arises from using it, rather than bloating out the seed itself with initial complexity.

Ive been thinking about starting stimple with a pi framework for example and letting the tools emerge, but this is so much more lean to start, i wonder if it will be more or less interesting and or useful to start here.

So while MSG is an excellent "neutral" umami ingredient, fermented products like this have a whole host of complex flavors that are often very desirable beyond just their glutamate salt.

The two measures are both great measures of house ownership that measure different things. The article frames the second one as better, and if you are looking to see the ownership proportion of people (for example as they note to look at the numbers of young people who live with parents) thats great. If however you care about the housing development decisions that will incentivise owner occupancy you might care more about the standard owner occupancy per household.

I often see this with respect to GDP/GDP per capita vs mean income and other economic measures, but its great to see a non economic measure like this compared in this way.

I hope you give startups another go if that sounds good to you, and as you say, it sounds like you will be able to see the things you dont want at least. Good luck.

Something im trying to lean into in my games is to ask the players who are voting no what their win condition or what they think they can make a go of is.

I think what ive said above could make me sound like one of the folks who "want the tightest possible loop to winning and restarting", so to add some nuance there, I think playing a game where the conclusion is foregone lacks agency, and in a game where one team eventually loses of course there is a blurry area where the team agrees that they are in fact never going to win, and then another question on whether they lie to play regardless. Because of the variation there, i like the vote, and i am in favor of coms around why someone wants to resign or stay.

I actually think it is up to players in an open loby system to communicate their intentions and reasons, and while it is true that it means people who spam coms trying to push folks around are possible, i would echo ptaqs sentiment to use that report function! and on a softer level, i really like the mute. if someone is too much, mute them and continue to enjoy your game.

Additionally it doesn't appear to reference the actual HUD report from 2025 https://www.huduser.gov/portal//portal/sites/default/files/p...

This at least has AFAICT the 100% figure, but the causal link seems unsubstantiated. The exact, unreferenced quote from the document is "Immigration accounts for up to 100 percent of housing demand growth in some regions, and for two-thirds of rental demand growth nationwide. In California and New York, immigrants have accounted for 100 percent of all rental growth and over one-half of all growth in owner-occupied housing in recent years." p45 with no further citation to back that up. I know its not an academic paper, but some citation would be good to back this up.

Id be interested in more information on causal data, or at least a more nuanced stance on such a strong statement. Or a less politically charged comment.

Full disclosure, i (obviously from my comment) dont lean right, but one thing i appreciate about HN is a more nuanced comment, and i think this is a chance for that.

  - "from my ai to yours" where ive pointed my ai at some relevant context, and asked it to transform it for other ai context that a coworker needs
  - "my thoughts prettied by AI" where i just polished up my own words, often for outside coms, but indicating that i wrote the bones of it.
  - "i wrote this myself" in my case i tend to be very casual with my written coms, and ive been leaning into this in the past year rather than looking to correct it, as it gives the personal feel. but for cases where ive written more thoughtfully, i just flat out say that.

Helps my team is small. interested in how this could be translated to more widespread "company culture"

I think there are trades where tool (or process if i may be allowed to extend the analogy) specialists exist and are highly valued. My dad is a plumber, so ill use that example but id trust similar is true for carpentry. there are specialists by task/output (new construction, repairs, boilers etc) but also tool specialist plumbers and companies for example drain clearing equipment or certain kinds of pipe for handling chemicals other than water are very specialised, and there are roles for them because the thing they enable, and the criticality of the task, and often the cost and complexity of using the tool are high enough to make specialisation valuable.

IMO software has, for the 10 years ive been working in it, been in an unusual position where the tools (languages, engineering practices, tech stacks) were super technical and involved, but also could be applied to a large number of problems. That is the perfect recipe for tool specialists: complex tool with high value and broad domain/problem space applicability.

Because of that tool specialisation, we've separated the application of the tool to a problem/domain from the tool use. reduction of complexity of applying these tools to many problems, means all domain specialists will use them, relying less on tool specialists.

imaging a mcguffin tool for attaching any two materials together, but which took a degree to figure out (loose hyperbole here), that sudenly you could use for 5 bucks and a quick glance at the first page of the manual. An industry that used to have lots of mcguffin engineers, would be mega disrupted, and you could argue that those tool specialists would have to identify more with what they were building than the mcguffin they were using.

I wish more corps took themselves so lightly, while remaining serious about what they do.