MATH · IN · MODELS

RFM/AGOP Steering Direction Extraction

Techniqueadvanced

Extracts a per-concept steering direction for diffusion-model U-Net/DiT activations by training a Recursive Feature Machine (RFM) as a target-vs-rest classifier on forward-noised (not reverse-sampled) labeled activations at a fixed low-noise timestep, then taking the sign-corrected, eigenvalue-weighted top-k eigenvectors of the RFM's Average Gradient Outer Product (AGOP) matrix as the direction to add back into activations during sampling.

Used in (2 observations)

structure: Linear Direction · models: MusicGen-Large · paper: Steering Autoregressive Music Generation with Recursive Feature Machines
structure: Linear Direction · models: DDPM (CIFAR-10, unconditional), DDPM (ImageNet 256x256), DDPM (CelebA-HQ 256x256, HuggingFace Diffusers), SiT-XL/2, Stable Diffusion v1.5 · paper: General and Efficient Steering of Diffusion Models