MATH · IN · MODELS
methods / Causal Validation / Representation Inversion / Intervention Lens (vec2text-based)

Representation Inversion / Intervention Lens (vec2text-based)

Techniqueadvanced

Inverts an embedding back into natural-language text via an iterative correction procedure (vec2text): a base model produces an initial text hypothesis from the target embedding, then a corrector model repeatedly refines it using the residual difference between the hypothesis's own embedding and the target embedding — applied to a POST-intervention (e.g. post-LEACE, post-MiMiC) representation, this makes an otherwise opaque representation-space edit legible as an actual change in text.

Used in (2 observations)

structure: Linear Subspace · models: RoBERTa-base · paper: Intervention Lens: from Representation Surgery to String Counterfactuals
structure: Linear Subspace · models: GTR-base, Mistral-7B, GPT-2-small · paper: Intervention Lens: from Representation Surgery to String Counterfactuals