Rangamani (2025) Modular-Addition RNN
Research (Rangamani 2025; custom-trained from scratch on modular addition, arXiv:2503.22059)
Structures found in this family (1)
By model (1)
Modular-Arithmetic Vanilla RNN (1 layer, tanh, d_h=256, mod 113)
Papers
Modular Addition in Recurrent Neural Networks Requires Low-Rank Fourier Circuits (2025)