MATH · IN · MODELS
methods / Causal Validation / Causal interventions (steering) / Activation Steering (Addition) / Spherical (Slerp) Activation Rotation Steering

Spherical (Slerp) Activation Rotation Steering

Techniqueadvanced

Steers a hidden activation by treating its normalized direction as a point on the unit hypersphere and moving it along the shortest geodesic (spherical linear interpolation, Slerp) toward a diff-in-means-derived target direction, then rescaling back to the original norm — a norm-preserving alternative to additive steering (CAA/ITI), with a von Mises-Fisher-based confidence gate setting the per-token rotation amount from the activation's own angular alignment.

Used in (1 observation)

structure: Linear Direction · models: Llama-3.1-8B-Instruct, Qwen2.5-7B-Instruct · paper: Spherical Steering: Geometry-Aware Activation Rotation for Language Models