OPT
Meta AI (Facebook AI Research)
Structures found in this family (5)
By model (6)
OPT-6.7B · 6.7B
OPT-1.3B · 1.3B
OPT-125M · 125M
OPT-13B · 13B
OPT-2.7B · 2.7B
OPT-350M · 350M
Observations (10)
Papers
Steering Language Models With Activation Engineering (2024), Investigating Representation Universality: Case Study on Genealogical Representations (2024), Massive Values in Self-Attention Modules are the Key to Contextual Knowledge Understanding (2025), Abstraction Induces the Brain Alignment of Language and Speech Models (2026), Latent Semantic Manifolds in Large Language Models (2026), Model Editing as a Robust and Denoised Variant of DPO: A Case Study on Toxicity (2024), The Shape of Learning: Anisotropy and Intrinsic Dimensions in Transformer-Based Models (2024), Bridging Information-Theoretic and Geometric Compression in Language Models (2023), Eliciting Latent Predictions from Transformers with the Tuned Lens (2023), The Intrinsic Dimension of Prompts in Internal Representations of Large Language Models (2025)