MiniLM

Microsoft

Structures found in this family (4)

Local hyperboloid-type quadric patch, Platonic Representation Hypothesis, Linear Direction, Anisotropy

By model (2)

all-MiniLM-L6-v2 · 22M

Local hyperboloid-type quadric patch, Platonic Representation Hypothesis, Linear Direction, Anisotropy

all-MiniLM-L12-v2 · 33M

Anisotropy

Observations (5)

Paraphrase neighborhoods are fit far better by a quadric than an affine subspace

Independently pretrained vision (DINOv2) and text (MiniLM) encoders develop graph-Laplacian eigenvalue spectra of near-identical intrinsic complexity, yet the functional map between their spectral eigenbases is far from diagonal or orthogonal -- a decoupling of 'how much structure' from 'how it is oriented' that bounds spectral cross-modal alignment methods and underperforms ambient-space alignment on retrieval

A von Mises-Fisher grounding direction separates grounded from hallucinated responses

A 'state of mind' spectrum is linearly decodable across five encoders

Dominant-dimension variance decides cosine vs rank metrics

Papers

Controlled Paraphrase Geometry in Sentence Embedding Space: Local Manifold Modeling and Latent Probing (2026), On the Spectral Geometry of Cross-Modal Representations: A Functional Map Diagnostic for Multimodal Alignment (2026), A Geometric Taxonomy of Hallucinations in Large Language Models (2026), Probing Spectrum-Like Organization of States of Mind in Transformer Representation Spaces (2026), Anisotropy Decides Cosine vs. Rank Metrics for Text Embeddings (2026)