MATH · IN · MODELS
methods / Theoretical / Analytical / Compressed-sensing capacity bounds

Compressed-sensing capacity bounds

Techniqueadvanced

Proves matching upper and lower bounds on how many k-sparse features m a d-dimensional linear representation can store such that a second linear map can recover them, using incoherent-matrix constructions for the upper bound and a rank/Turán-theorem argument for the lower bound.

Used in (1 observation)

structure: Linear Direction, Linear Separability, Linear Representation Hypothesis · models: · paper: How Many Features Can a Language Model Store Under the Linear Representation Hypothesis?