MATH · IN · MODELS

Grokking Modular-Arithmetic MLP

Research (custom-trained from scratch on modular addition, MLP architecture as a non-attention grokking comparison point)

Structures found in this family (1)

By model (1)

Grokking Modular-Arithmetic MLP (3 hidden layers, width 512, d_embed=128, mod 113/149/197)

Papers

Topological Signatures of Grokking (2026)