MATH · IN · MODELS
methods / Causal Validation / OV-circuit unembedding-diagonal projection

OV-circuit unembedding-diagonal projection

Techniqueadvanced

Composes an attention head's full OV (and QK) circuit with the model's own embedding/unembedding matrices to get an explicit vocab-by-vocab matrix, then checks whether each token's own diagonal entry (its self-projection through the circuit) is an extreme (most negative, or most positive) value in its row/column — turning a component's weights into a directly quantified per-token directional claim, rather than a purely behavioral/functional description of what the head does.

Used in (1 observation)

structure: Linear Direction · models: GPT-2-small · paper: Copy Suppression: Comprehensively Understanding an Attention Head