Relation-frame shape steering

methods / Causal Validation / Activation patching / Relation-frame shape steering

Techniqueadvanced

Decomposes a clean/corrupt interchange-intervention on a relation-bound token cloud into separately-movable components — centroid translation, centered shape, Procrustes rotation, Grassmann subspace — to test which component of the cloud's geometry, not just its identity as a patched site, causes behavioral recovery.

Used in (1 observation)

Relations bind tokens into an oriented frame whose shape is causally steerablemeasured

structure: Relation frame (ordered multi-token tuple geometry) · models: Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct, Llama-3.1-405B-Instruct · paper: Relational Rank Geometry in Transformers: Detecting and Steering Hidden-State Relation Frames