MATH · IN · MODELS
methods / Theoretical / Analytical / K-means + silhouette-score mode discovery

K-means + silhouette-score mode discovery

Techniqueintermediate

Runs k-means over a PCA-reduced activation population for a sweep of cluster counts k, reporting the maximum silhouette score achieved as a scalar 'how cleanly does this population split into discrete modes' statistic — used to compare whether one domain's representations organize into sharply-separated discrete clusters while another remains a single smooth blob.

Used in (1 observation)

structure: Concept Cluster Heterogeneity · models: Llama-3-8B-Instruct, Llama-3.1-70B-Instruct · paper: The Geometry of Thought: How Scale Restructures Reasoning in Large Language Models