iBOT

ByteDance / Academic

Structures found in this family (2)

Linear Subspace, Intrinsic-dimension profile across depth

By model (2)

iBOT ViT-B/16

Linear Subspace, Intrinsic-dimension profile across depth

iBOT ViT-L/16 · 307M

Linear Subspace

Observations (3)

DINOv2 and Stable Diffusion encode depth/normals via nonlinear dense probes

MST intrinsic dimension of frozen SSL features predicts probe accuracy

SVD-extracted ViT-L task subspaces recover most full-feature performance

Papers

Probing the 3D Awareness of Visual Foundation Models (2024), IdEst: Assessing Self-Supervised Learning Representations via Intrinsic Dimension (2026), Understanding Geometric Representations in Self-Supervised Vision Transformers via Subspace Intervention (2026)