MATH · IN · MODELS

Open-ended scalar concepts trace affine 1D lines

measured in 1 paper

Bhalla et al. find simple open-ended scalar concepts (temperature, age) trace flat open 1D lines in Llama-3.1-8B's layer-19 residual stream, via PCA across sampled prompt values [bhalla-etal-2026] Causal steering along interpolated points between binned centroids is validated only for temperature, color, and day-of-week (e.g. freezing to cold to warm to hot), producing smooth monotonic output shifts [bhalla-etal-2026] Age and years show the same open 1D structure by PCA but were not steered, so their causal load-bearing status is not established here [bhalla-etal-2026] Formality, sentence length, and a synthetic political-bias score show similar roughly-1D structure with PCA evidence only [bhalla-etal-2026]

Context

manifold ubiquity, continuous concepts

Confirmed in models

Papers

Do Sparse Autoencoders Capture Concept Manifolds? — Bhalla, Usha, Fel, Thomas, Rager, Can, Feucht, Sheridan, Haklay, Tal, Wurgaft, Daniel, Boppana, Siddharth, Kowal, Matthew, Shyam, Vasudev, Lewis, Owen, McGrath, Thomas, Merullo, Jack, Geiger, Atticus, Lubana, Ekdeep Singh2026 · arXiv:2604.28119