MATH
·
IN
·
MODELS
The map
Structures
Hypotheses
Classification
Matrix
Methods bubble
Genealogy
Families
Papers
Methods
Why
XLNet
Google/CMU
Structures found in this family (1)
Anisotropy
By model (1)
XLNet-base-cased
· 110M
Anisotropy
Observations (1)
A few rogue dimensions drive transformer anisotropy
Papers
All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality (2021)