MATH · IN · MODELS

Convergent Evolution controlled 300M architecture comparison (Fu, Zhou, Belkin, Sharan & Jia 2026)

USC / UC San Diego

Structures found in this family (1)

Linear Subspace

By model (3)

Convergent-Evolution 300M controlled Linear RNN (Gated DeltaNet) · 300M
Linear Subspace
Convergent-Evolution 300M controlled LSTM · 300M
Linear Subspace
Convergent-Evolution 300M controlled Transformer · 300M
Linear Subspace

Observations (1)

Fourier periodicity in number embeddings is universal; linear separability is not

Papers

Convergent Evolution: How Different Language Models Learn Similar Number Representations (2026)