MATH · IN · MODELS
methods / Causal Validation / Orthogonal Weight-Rotation Concept Erasure (OCE)

Orthogonal Weight-Rotation Concept Erasure (OCE)

Techniqueadvanced

Edits a pretrained diffusion model's cross-attention weight matrix in place with a single closed-form orthogonal (rotation) matrix, solved via the orthogonal Procrustes problem, that maps target-concept key/value directions toward an anchor concept while leaving every neuron's norm and every pairwise inter-neuron angle exactly unchanged by construction (Q^top Q = I) -- unlike additive or per-neuron edits, which distort the surrounding weight geometry.

Used in (1 observation)

structure: Linear Direction · models: Stable Diffusion v1.4, FLUX.1 · paper: Orthogonal Concept Erasure for Diffusion Models