MATH · IN · MODELS
methods / Dictionary Learning / Ising coactivation analysis

Ising coactivation analysis

Techniqueadvanced

Fits a pairwise Ising (binary graphical) model to a sparse dictionary's atom activations to recover the direct, conditional-independence-adjusted couplings between atoms — then groups atoms into candidate manifolds by their coupling sign/strength, rather than by decoder-direction similarity.

Used in (1 observation)

structure: Circle, Affine Subspace, Paraboloid (circular × pinched continuum) · models: Llama-3.1-8B · paper: Do Sparse Autoencoders Capture Concept Manifolds?