New comment by folderquestion in "A polynomial autoencoder beats PCA on transformer embeddings"

folderquestion — Fri, 08 May 2026 09:32:09 +0000

This sound like projecting data into the linear space spanned by {x_i, x_i*x_j} where x_i are the features variables, and then applying standard regularization methods to remove noise and low value coefficients.

Anisotropy and the cone ideas may explain why PCA underperforms, but it does not uniquely justify this particular quadratic decoder. The geometric story is not doing explanatory work beyond “data is nonlinear,” and the real substance is simply that second-order reconstruction empirically helps.

New comment by folderquestion in "AI slop is killing online communities"

folderquestion — Thu, 07 May 2026 22:56:28 +0000

The web could become a way to indicate identity if public institutions publish for example www.university-country/professors/John. And that implies that John is a professor. I designed a 6000 lines protocol, but anyone could construct that web using hmac(salt+ url).

Hacker News: folderquestion

New comment by folderquestion in "A polynomial autoencoder beats PCA on transformer embeddings"

New comment by folderquestion in "AI slop is killing online communities"