Linear relational concepts (LRC)

methods / Direction Extraction / Linear relational concepts (LRC)

Techniqueintermediate

Extracts a concept direction for a specific (relation, object) pair by inverting a linear relational embedding — a learned affine map from subject activations to object activations — rather than contrasting two labeled classes.

Used in (2 observations)

Linear relational concepts invert an LRE into an editable object directionmeasured

structure: Linear Direction · models: Llama-2-7B, GPT-J-6B · paper: Identifying Linear Relational Concepts in Large Language Models

Hierarchical concepts occupy domain-specific 150-250D subspaces, steerablemeasured

structure: Linear Subspace · models: Llama-3.2-3B, Llama-3.1-8B, Qwen3-8B, Qwen3-14B · paper: Linear Representations of Hierarchical Concepts in Language Models