MATH · IN · MODELS
methods / Direction Extraction / Diffusion-inversion probing

Diffusion-inversion probing

Techniqueadvanced

Approximately inverts a diffusion model's deterministic sampling process (integrating the learned velocity/score field backward from a clean sample to noise) to recover intermediate diffusion-transformer states, then fits a linear probe on those recovered states — extending linear probing to generative diffusion models whose forward pass alone doesn't expose a clean encoder representation to probe.

Used in (1 observation)

structure: Linear Separability · models: Wan2.1-1.3B, CogVideoX-2B, LTX-Video (diffusion-based video generator), V-JEPA (video joint-embedding predictive architecture), VideoMAE-base · paper: The Invisible Hand of Physics: When Video Diffusion Models Know More Than They Show