MATH · IN · MODELS

AlphaZero-Hex cell embeddings grow to match board adjacency

measured in 1 paper

Lovering et al. extract a first-layer embedding per Hex board cell from AlphaZero's policy/value network and compute pairwise dot products between all cell embeddings [lovering-etal-2022-alphazero-hex-concepts] Alignment of this dot-product structure with ground-truth board adjacency, measured by NDCG, increases substantially over training, improving about halfway through before plateauing [lovering-etal-2022-alphazero-hex-concepts] This geometric claim is distinct from the paper's separate concept-probing-accuracy and behavioral analyses, which report only classifier accuracy and input-output checks [lovering-etal-2022-alphazero-hex-concepts]

Context

cell/board-position embeddings, pairwise dot-product structure, Normalized Discounted Cumulative Gain (NDCG) as a structure-alignment metric, emergence of spatial structure over training

Papers

Evaluation Beyond Task Performance: Analyzing Concepts in AlphaZero in Hex — Lovering, Charles, Forde, Jessica Zosa, Konidaris, George, Pavlick, Ellie, Littman, Michael L.2022 · arXiv:2211.14673