Maheswaranathan et al. 2019 RNN population study (Vanilla/UGRNN/GRU/LSTM) — Math in LLMs Research Map

MATH · IN · MODELS

Maheswaranathan et al. 2019 RNN population study (Vanilla/UGRNN/GRU/LSTM)

Stanford / Google Brain

Structures found in this family (1)

Fixed-point graph topology (population-level universality of RNN dynamical structure)

By model (1)

Population of ~2,880 independently-trained RNNs (Vanilla/UGRNN/GRU/LSTM)

Fixed-point graph topology (population-level universality of RNN dynamical structure)

Observations (1)

Fixed-point graph topology is universal across large populations of independently-trained RNNs

Papers

Universality and Individuality in Neural Dynamics Across Large Populations of Recurrent Networks (2019)