MATH
·
IN
·
MODELS
The map
Structures
Hypotheses
Classification
Matrix
Methods bubble
Genealogy
Families
Papers
Methods
Why
ERNIE
Baidu
Structures found in this family (1)
Anisotropy
By model (1)
ERNIE-4.5-21B-A3B-Base
· 21B-A3B
Anisotropy
Observations (1)
MoE routing reflects hidden-state geometry, not domain expertise
Papers
The Myth of Expert Specialization in MoEs: Why Routing Reflects Geometry, Not Necessarily Domain Expertise (2026)