MATH
·
IN
·
MODELS
The map
Structures
Hypotheses
Classification
Matrix
Methods bubble
Genealogy
Families
Papers
Methods
Why
TinyLlama
TinyLlama project
Structures found in this family (1)
Representational-similarity trajectory across depth
By model (1)
TinyLlama-1.1B
· 1.1B
Representational-similarity trajectory across depth
Observations (1)
Real GPT-2, TinyLlama, and Qwen2.5 representation trajectories show higher curvature for reasoning than lexical tasks, and a universal three-phase layerwise structure
Papers
Trajectory Geometry of Transformer Representations Across Layers (2026)