MATH · IN · MODELS

Claude Sonnet 4.5 encodes 171 emotion directions that steer safety behavior

measured in 1 paper

Sofroniew et al. (Anthropic) extract ~171 linear emotion-concept directions in Claude Sonnet 4.5's residual stream via diff-in-means over emotion words [sofroniew-etal-2026-emotion-concepts-and-their-function-in-a-large-language-model] The directions generalize across contexts and roughly align with a valence/arousal circumplex when visualized via PCA [sofroniew-etal-2026-emotion-concepts-and-their-function-in-a-large-language-model] Injecting or suppressing specific emotion directions measurably changes reward-hacking, blackmail, and sycophancy rates in held-out scenarios [sofroniew-etal-2026-emotion-concepts-and-their-function-in-a-large-language-model] The result ties frontier-model linear emotion geometry directly to safety-relevant behavior at higher granularity than prior 2D-circumplex claims [sofroniew-etal-2026-emotion-concepts-and-their-function-in-a-large-language-model]

Context

emotion representations, valence-arousal circumplex, safety behavior, reward hacking, sycophancy, Claude

Confirmed in models

Papers

Emotion Concepts and their Function in a Large Language Model — Sofroniew, Nicholas, Kauvar, Isaac, Saunders, William, Chen, Runjin, Henighan, Tom, Hydrie, Sasha, Citro, Craig, Pearce, Adam, Tarng, Julius, Gurnee, Wes, Batson, Joshua, Zimmerman, Sam, Rivoire, Kelley, Fish, Kyle, Olah, Chris, Lindsey, Jack2026 · arXiv:2604.07729