RFM/AGOP directions from frozen MusicGen enable real-time multi-attribute steering

Zhao et al. adapt Recursive Feature Machines / Average Gradient Outer Product to train lightweight layer-wise probes on frozen MusicGen-Large hidden states using the SynTheory music-theory dataset [zhao-etal-2025-steering-autoregressive-music-generation-with-rfm] The AGOP-derived concept directions capture fine-grained musical attributes such as notes and chords [zhao-etal-2025-steering-autoregressive-music-generation-with-rfm] Injecting these directions at inference enables real-time steering without per-step optimization, including time-varying schedules and simultaneous multi-attribute control [zhao-etal-2025-steering-autoregressive-music-generation-with-rfm]