Claude

Anthropic

Structures found in this family (2)

Linear Direction, 1D continuum manifold

Hypotheses argued for by this family (2)

Translation Symmetry Hypothesis, Efficient/Capacity-Optimal Coding Hypothesis

By model (3)

Claude 3 Sonnet

Linear Direction

Claude 3.5 Haiku

1D continuum manifold

Claude Sonnet 4.5

Linear Direction

Observations (4)

Claude-3-Sonnet SAE features causally steer safety behaviors and split with scale

Claude Sonnet 4.5 encodes 171 emotion directions that steer safety behavior

Crosscoders recover shared cross-layer and cross-model features

Ordered continuous concepts trace a rippled open 1D (Lissajous) manifold

Papers

Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet (2024), Emotion Concepts and their Function in a Large Language Model (2026), Sparse Crosscoders for Cross-Layer Features and Model Diffing (2024), Symmetry in Language Statistics Shapes the Geometry of Model Representations (2026), When Models Manipulate Manifolds: The Geometry of a Counting Task (2025)