Custom Research Contrastive MoE-CNN (sparsely-gated ResNet trained with SimCLR)
various (academic)
Structures found in this family (1)
By model (1)
Sparsely-gated contrastive MoE-CNN, E=8 experts (Tangtartharakul & Storrs 2026) · ~46M, ResNet backbone + 3-layer MLP readout, top-2 routing, trained via SimCLR on STL10
Papers
Beyond Routing: Characterising Expert Tuning and Representation in Vision Mixture-of-Experts (2026)