Bag-of-Words Superposition Autoencoder (BOWS)
Research (Prieto, Stevinson, Barsbey, Birdal & Mediano 2026; tied-weight autoencoder, custom-trained from scratch on binary bag-of-words vectors of WikiText-103 / OpenWebText text chunks)
Structures found in this family (2)
By model (2)
BOWS Autoencoder (tied-weight, linear — no ReLU, baseline)
BOWS Autoencoder (tied-weight, ReLU)
Papers
From Data Statistics to Feature Geometry: How Correlations Shape Superposition (2026)