MATH · IN · MODELS
methods / Theoretical / Analytical / Representational Separability Analysis (inter-to-intra scatter ratio)

Representational Separability Analysis (inter-to-intra scatter ratio)

Techniqueintermediate

A Fisher-discriminant-style score S(l,k) = ||mu_A - mu_B|| / (intra-cluster variances) computed per layer/attention-head on a frozen model's real activations, quantifying how entangled or separable two behaviorally-defined classes' representation manifolds are at that specific site — used to rank sites for a targeted geometric intervention rather than intervening uniformly.

Used in (1 observation)

structure: Linear Separability · models: InternVL3-8B · paper: Steering and Rectifying Latent Representation Manifolds in Frozen Multi-modal LLMs for Video Anomaly Detection