Linear Separability, Anisotropy

Emergence of Separable Manifolds in Deep Language Representations (2020), Outlier Dimensions Encode Task-Specific Knowledge (2023), The Shape of Learning: Anisotropy and Intrinsic Dimensions in Transformer-Based Models (2024)