MATH · IN · MODELS

Ordinal Local-Comparison Toy Transformer

Research (Singh 2026; custom-trained from scratch on adjacent-pair comparisons over total orders of N=10/15/20 synthetic entities)

Structures found in this family (1)

1D continuum manifold

By model (1)

1-Layer Ordinal Local-Comparison Transformer
1D continuum manifold

Observations (1)

Weight decay collapses ordinal embeddings onto a monotone end-anchored line

Papers

Emergent Ordinal Geometry in Transformers Trained on Local Comparisons (2026)