MATH · IN · MODELS

Swaroop (2026) modular-arithmetic ReLU MLP

Research (Swaroop 2026; custom-trained from scratch on modular arithmetic)

Structures found in this family (1)

By model (1)

Swaroop ReLU MLP on modular arithmetic (1 hidden layer, width 256, mod 97)

Papers

Latent Algorithmic Structure Precedes Grokking: A Mechanistic Study of ReLU MLPs on Modular Arithmetic (2026)