MusicGen

Meta AI

Structures found in this family (2)

Linear Direction, Linear Separability

By model (2)

MusicGen-Large · 3.3B

Linear Direction, Linear Separability

MusicGen-Small · 300M

Linear Direction, Linear Separability

Observations (3)

RFM/AGOP directions from frozen MusicGen enable real-time multi-attribute steering

SAE decoder directions in MusicGen are causally steerable; listeners prefer steered audio

MLP probes decode seven music-theory concepts from generative models

Papers

Steering Autoregressive Music Generation with Recursive Feature Machines (2025), Discovering and Steering Interpretable Concepts in Large Generative Music Models (2026), Do Music Generation Models Encode Music Theory? (SynTheory) (2024)