MATH · IN · MODELS
methods / Causal Validation / OSCaR (Orthogonal Subspace Correction and Rectification)

OSCaR (Orthogonal Subspace Correction and Rectification)

Techniqueadvanced

Rather than projecting a bias direction out of every word vector, measures the pre-existing angle between two 1-dimensional concept directions (e.g. gender and occupation) and applies a smooth, data-dependent partial rotation that pushes only the second direction to orthogonality with the first, leaving points far from both directions almost untouched — trading some bias reduction for substantially better information retention.

Used in (1 observation)

structure: Linear Direction · models: GloVe (840B token Common Crawl), RoBERTa-base · paper: OSCaR: Orthogonal Subspace Correction and Rectification of Biases in Word Embeddings