The foundational king-man+woman parallelogram analogy in RNNLM vectors

Mikolov, Yih & Zweig establish in trained RNNLM word representations that syntactic and semantic relationships are encoded as approximately consistent linear offset vectors between word-vector pairs [mikolov-etal-2013-linguistic-regularities-continuous-space] Vector arithmetic (king - man + woman) retrieves the analogically correct target word (queen) via nearest-neighbor cosine similarity on a purpose-built analogy benchmark [mikolov-etal-2013-linguistic-regularities-continuous-space] This is the founding empirical demonstration of the linear/parallelogram analogy geometry [mikolov-etal-2013-linguistic-regularities-continuous-space] Essentially all later linear-representation-hypothesis work in this map builds on and re-derives it in other model families [mikolov-etal-2013-linguistic-regularities-continuous-space]