MATH · IN · MODELS
methods / Causal Validation / Causal interventions (steering) / LoRA-trained direction realization

LoRA-trained direction realization

Techniqueadvanced

Trains a low-rank (LoRA) weight-space adapter so that the adapter's own induced change in generated images causally realizes a target semantic direction -- either a directly-supervised contrastive-prompt-pair direction, or (in a later extension) a pre-discovered PCA direction matched via a cosine-alignment loss -- turning a direction into an actively causal, reusable weight-space edit, as distinct from inference-time activation addition.

Used in (2 observations)

structure: Linear Direction · models: Stable Diffusion XL, Stable Diffusion v1.4 · paper: Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models
structure: Linear Direction · models: SDXL-DMD (4-step distilled), Stable Diffusion XL, SDXL Turbo, FLUX.1 [schnell] · paper: SliderSpace: Decomposing the Visual Capabilities of Diffusion Models