MATH
·
IN
·
MODELS
The map
Structures
Hypotheses
Classification
Matrix
Methods bubble
Genealogy
Families
Papers
Methods
Why
Toy Superposition Autoencoder (Elhage et al.)
Anthropic
Structures found in this family (1)
Polytope (Simplex)
By model (1)
Toy ReLU-output autoencoder (h=Wx, x'=ReLU(W^T h + b))
Polytope (Simplex)
Observations (1)
Superposed features arrange into uniform polytopes with quantized dimensionality
Papers
Toy Models of Superposition (2022)