MATH · IN · MODELS
methods / Theoretical / Analytical / Geometric analysis / Rotation-invariance isomorphism test

Rotation-invariance isomorphism test

Techniqueintermediate

Tests whether a model's internal relational structure among a set of concepts corresponds to an external grounded space up to rotation (not exact position), by comparing behavioral performance on the true grounding against a structure-preserving rotation of it and against a structure-destroying random reassignment — inferring isomorphism from a rotation/randomization performance gap rather than fitting an explicit map between activation vectors.

Used in (1 observation)

structure: Linear Subspace · models: GPT-2 Small, GPT-2-XL, GPT-3 (175B, davinci), BERT-base-uncased · paper: Mapping Language Models to Grounded Conceptual Spaces