MATH · IN · MODELS

Timestep-conditioned transcoder directions give exact FLUX attribution graphs

measured in 1 paper

Mazur et al. (DifFRACT) train timestep-conditioned FiLM-modulated transcoders replacing FLUX.1[schnell]'s MLP sublayers, giving an exact linear feature-to-feature attribution across the denoising trajectory [mazur-etal-2026-timestep-conditioned-transcoder-directions-flux] The attribution graphs reveal a structural shift: text-stream contribution falls from 89.9% to 5.4% while image-stream contribution rises from 10.1% to 94.6% across 4 denoising steps [mazur-etal-2026-timestep-conditioned-transcoder-directions-flux] Feature-level activation scaling causally corrects color-bias failures on 60% of tested seeds only when feature suppression is combined with context suppression [mazur-etal-2026-timestep-conditioned-transcoder-directions-flux] Single-feature steering alone fails, evidencing causal structure distributed across coupled features rather than reducible to one direction [mazur-etal-2026-timestep-conditioned-transcoder-directions-flux]

Context

timestep-conditioned transcoders, diffusion transformer circuit tracing, text-to-image stream contribution shift

Confirmed in models

Papers

DifFRACT: Diffusion Feature Reconstruction and Attribution for Circuit Tracing — Mazur, Artyom, Konovalova, Nina, Alanov, Aibek2026 · arXiv:2606.15796