MATH · IN · MODELS

Analogy preservation is necessary and sufficient for a linear cross-lingual map

measured in 1 paper

Peng et al. prove a necessary-and-sufficient equivalence between within-language analogy (parallelogram) preservation and linearity of the ground-truth cross-lingual embedding map [peng-etal-2020-understanding-linearity-cross-lingual-mappings] They test it against real monolingual embeddings across 12 languages (fastText-Wiki, fastText-CommonCrawl, word2vec-CoNLL) using a new 5-category cross-lingual analogy dataset [peng-etal-2020-understanding-linearity-cross-lingual-mappings] Mapping-linearity quality tracks analogy-preservation quality empirically [peng-etal-2020-understanding-linearity-cross-lingual-mappings] No causal intervention is performed [peng-etal-2020-understanding-linearity-cross-lingual-mappings]

Context

analogy-linearity equivalence, cross-lingual map linearity

Papers

Understanding Linearity of Cross-Lingual Word Embedding Mappings — Peng, Xutan, Stevenson, Mark, Lin, Chenghua, Li, Chen2020 · arXiv:2004.01079