waypoints.si The sky Every system The lead Countries Forecast revisions
MoE-Multi
Other universities, 23 Jan 2017.
- Lab
- Other universities
- Released
- 23 Jan 2017
- Kind
- Language, Language modeling
- Training compute
- 9.3 × 10¹⁹ FLOP
- Parameters
- 8.7 billion
- Organisations
- Jagiellonian University, Google Brain
- Country
- Other
See it in the 3D sky Paper or announcement
Data: Epoch AI (Creative Commons Attribution), releases too new for it from OpenRouter, and METR. Updated 25 Sep 2026.