MATH
·
IN
·
MODELS
The map
Structures
Hypotheses
Classification
Matrix
Methods bubble
Genealogy
Families
Papers
Methods
Why
TinyModel (TinyStories-trained)
Noa Nabeshima (independent)
Structures found in this family (1)
Linear Direction
By model (1)
TinyModel-4L (TinyStories)
· ~30M
Linear Direction
Observations (1)
Matryoshka nested dictionaries reduce SAE feature absorption
Papers
Learning Multi-Level Features with Matryoshka Sparse Autoencoders (2025)