Directional class-distance-normalized variance (directional CDNV)

methods / Theoretical / Analytical / Directional class-distance-normalized variance (directional CDNV)

Directional class-distance-normalized variance (directional CDNV)

Techniqueadvanced

Projects a class's within-class covariance onto the class-mean-separating (decision) axis before computing the class-distance-normalized-variance ratio, isolating collapse specifically along task-relevant directions from variance left standing in orthogonal, task-irrelevant (nuisance) directions.

Used in (1 observation)

SSL encoders collapse variance along each task's decision axis, aiding few-shot transfermeasured

structure: Polytope (Simplex) · models: SimCLR ResNet-18 (mini-ImageNet), MAE ViT-Base (Masked Autoencoder), DINOv2 ViT-B/16, CLIP ViT-B/32 · paper: Directional Neural Collapse Explains Few-Shot Transfer in Self-Supervised Learning