MATH · IN · MODELS

Torre et al. 2025 RNNs Emulating Hidden Markov Models

Research (Torre, Viscione, Pompe, Grewe & Mante 2025; custom-trained from scratch to replicate HMM emission statistics)

Structures found in this family (1)

Circle

By model (1)

Torre et al. 2025 vanilla ReLU RNN (50-200 units) trained to emulate HMM emissions · 50-200 units
Circle

Observations (1)

Trained vanilla ReLU RNNs emulating hidden Markov models collapse to a single fixed point without input and show noise-sustained rotation along closed orbits whose phase modulates emission probabilities

Papers

Mechanistic Interpretability of RNNs emulating Hidden Markov Models (2025)