AlphaZero-Hex cell embeddings grow to match board adjacency
measured in 1 paperLovering et al. extract a first-layer embedding per Hex board cell from AlphaZero's policy/value network and compute pairwise dot products between all cell embeddings [lovering-etal-2022-alphazero-hex-concepts] Alignment of this dot-product structure with ground-truth board adjacency, measured by NDCG, increases substantially over training, improving about halfway through before plateauing [lovering-etal-2022-alphazero-hex-concepts] This geometric claim is distinct from the paper's separate concept-probing-accuracy and behavioral analyses, which report only classifier accuracy and input-output checks [lovering-etal-2022-alphazero-hex-concepts]
Structure
Context
cell/board-position embeddings, pairwise dot-product structure, Normalized Discounted Cumulative Gain (NDCG) as a structure-alignment metric, emergence of spatial structure over training
Confirmed in models
Method
Papers
Evaluation Beyond Task Performance: Analyzing Concepts in AlphaZero in Hex — Lovering, Charles, Forde, Jessica Zosa, Konidaris, George, Pavlick, Ellie, Littman, Michael L.