Prompt-set symmetries provably transfer into simplex-ETF and circulant geometry
measured in 1 paperDu, He & Su prove a symmetry-transfer principle: the symmetry group acting on next-token completions is inherited by the optimal class-mean/embedding geometry under the layer-peeled objective [du-etal-2026-uncovering-symmetry-transfer] Permutation symmetry forces a Simplex Equiangular Tight Frame while cyclic-shift symmetry forces a circulant matrix structure [du-etal-2026-uncovering-symmetry-transfer] Both predictions are confirmed on real Mistral-7B-Instruct-v0.3 output-projection and context-embedding Gram matrices for permutation- and cyclic-symmetric prompt sets (days of the week, months of the year) [du-etal-2026-uncovering-symmetry-transfer]
Structure
Context
symmetry transfer, layer-peeled optimization, circulant matrix geometry, cyclic-shift symmetry
Confirmed in models
Papers
Uncovering Symmetry Transfer in Large Language Models via Layer-Peeled Optimization — Du, Zhehang, He, Hangfeng, Su, Weijie