MATH · IN · MODELS
methods / Theoretical / Analytical / RFM/AGOP Subspace Extraction (LLM activations)

RFM/AGOP Subspace Extraction (LLM activations)

Techniqueadvanced

Trains a Recursive Feature Machine (RFM) as a target-vs-rest classifier directly on transformer residual-stream activations, then takes the ranked top-k eigenvectors of the resulting Average Gradient Outer Product (AGOP) matrix as a multi-dimensional concept subspace — a cheaper kernel-machine alternative to iterative diff-in-means/PCA subspace search that yields an explicit ranking of how many dimensions a concept needs.

Used in (1 observation)

structure: Cone · models: Qwen3-1.7B, Qwen3-4B, Qwen3-8B, Qwen3-14B, Qwen2.5-7B-Instruct · paper: Fast Multi-dimensional Refusal Subspaces via RFM-AGOP