ELECTRA

Google

Structures found in this family (2)

Linear Subspace, Anisotropy

By model (2)

ELECTRA-base · 110M

Anisotropy

ELECTRA-large (discriminator) · 335M

Linear Subspace

Observations (2)

Text-only LMs linearly recover CIELAB color-space structure

Dominant-dimension variance decides cosine vs rank metrics

Papers

Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color (2021), Anisotropy Decides Cosine vs. Rank Metrics for Text Embeddings (2026)