MATH · IN · MODELS

Whisper

OpenAI

Structures found in this family (4)

Linear Direction, Linear Separability, Linear Subspace, Intrinsic-dimension profile across depth

By model (4)

Whisper base
Linear Separability, Linear Subspace, Linear Direction
Whisper large
Intrinsic-dimension profile across depth
Whisper large-v3
Linear Direction
Whisper small
Linear Direction

Observations (5)

TopK SAE features on real Whisper and HuBERT encoders are seed-stable and sparsely erasable, and steering them causally cuts Whisper false-speech detections by 70%
Whisper hallucination is linearly decodable and causally steerable
Indic dialect geography nests linearly inside each language's subspace
Layer intrinsic-dimension peak aligns with the best brain-predicting layer
Monosemantic Whisper SAE latents encode phonetic/lexical features and steer transcripts

Papers

AudioSAE: Towards Understanding of Audio-Processing Models with Sparse AutoEncoders (2026), Whisper Hallucination Detection and Mitigation via Hidden Representation Steering and Sparse AutoEncoders (2026), Analyzing Language and Geographical Variation in Speech Representations Across 60 Indic Languages (2026), Abstraction Induces the Brain Alignment of Language and Speech Models (2026), Mechanistic Interpretability of ASR models using Sparse Autoencoders (2026)