MATH · IN · MODELS
methods / Direction Extraction / Recursive Feature Machine (RFM)

Recursive Feature Machine (RFM)

Techniqueintermediate

A kernel-machine probe that iteratively reweights input features via the average gradient outer product (the feature matrix), learning a data-adaptive Mahalanobis metric; used as a probe more expressive than a plain linear classifier while still yielding an interpretable feature-importance direction.

Used in (1 observation)

structure: Linear Separability · models: Qwen3-8B, Llama-3.1-8B-Instruct, Gemma 3 4B Instruct · paper: Catching Rationalization in the Act: Detecting Motivated Reasoning Before and After CoT via Activation Probing