MATH · IN · MODELS
methods / Causal Validation / Diffusion Steering Lens (DSL)

Diffusion Steering Lens (DSL)

Techniqueintermediate

Linearly interpolates a corrupted vision-transformer representation toward a clean reference (x_new = x* + alpha(x - x*)) and patches the result into subsequent submodule outputs before decoding through the model's own generative (diffusion) decoder — a causally-validated alternative to a vanilla Diffusion Lens/Logit Lens for visualizing what a given attention head or MLP directly contributes.

Used in (1 observation)

structure: Linear Direction · models: CLIP ViT-bigG/14 (Kandinsky 2.2 image encoder) · paper: Decoding Vision Transformers: The Diffusion Steering Lens