MATH · IN · MODELS

Tian (2024/2025) Quadratic-Activation Toy MLP

Research (Tian, NeurIPS 2025; custom-trained from scratch on synthetic modular-addition/Abelian-group tasks, arXiv:2410.01779)

Structures found in this family (1)

By model (1)

2-layer quadratic-activation MLP (widths 20/512/1024, modular addition mod p in {23,71,127})

Papers

Composing Global Solutions to Reasoning Tasks via Algebraic Objects in Neural Nets (2024)