MATH · IN · MODELS
methods / Theoretical / Analytical / Plücker sign entropy

Plücker sign entropy

Techniqueadvanced

Projects hidden states into a fixed low-rank subspace, then measures whether relation-bound token tuples share a more consistent determinant-sign (orientation) pattern at the arity-matched rank than scrambled or random controls — a rank-indexed diagnostic for relation frames.

Used in (1 observation)

structure: Relation frame (ordered multi-token tuple geometry) · models: Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct, Llama-3.1-405B-Instruct · paper: Relational Rank Geometry in Transformers: Detecting and Steering Hidden-State Relation Frames