MATH · IN · MODELS

OpenLLaMA

OpenLM Research

Structures found in this family (2)

Aristotelian Representation Hypothesis, Platonic Representation Hypothesis

By model (3)

OpenLLaMA-13B · 13B
Aristotelian Representation Hypothesis, Platonic Representation Hypothesis
OpenLLaMA-3B · 3B
Aristotelian Representation Hypothesis, Platonic Representation Hypothesis
OpenLLaMA-7B · 7B
Aristotelian Representation Hypothesis, Platonic Representation Hypothesis

Observations (2)

After correcting CKA and mutual k-NN alignment for a proven width/depth-dependent null-baseline confound (O(d/n) for global spectral metrics vs O(k/n) for local-neighborhood metrics), the Platonic Representation Hypothesis's global cross-modal convergence largely vanishes while its local-neighborhood convergence survives, across real image-text and video-language pretrained model pairs
Cross-model and cross-modal representational alignment increases with scale and competence

Papers

Revisiting the Platonic Representation Hypothesis: An Aristotelian View (2026), The Platonic Representation Hypothesis (2024)