Wu, Geiger & Millière (2025) Variable-Binding Toy Transformer
Research (Wu, Geiger & Millière, ICML 2025; custom-trained from scratch on synthetic variable-assignment programs, arXiv:2505.20896)
Structures found in this family (1)
By model (1)
12-layer, 8-head causal Transformer (d_model=512, RoPE, synthetic variable-assignment-program task)
Papers
How Do Transformers Learn Variable Binding in Symbolic Programs? (2025)