methods / Causal Validation / Orthogonal Weight-Rotation Concept Erasure (OCE)
Orthogonal Weight-Rotation Concept Erasure (OCE)
Edits a pretrained diffusion model's cross-attention weight matrix in place with a single closed-form orthogonal (rotation) matrix, solved via the orthogonal Procrustes problem, that maps target-concept key/value directions toward an anchor concept while leaving every neuron's norm and every pairwise inter-neuron angle exactly unchanged by construction (Q^top Q = I) -- unlike additive or per-neuron edits, which distort the surrounding weight geometry.