waypoints.si The sky Every system The lead Countries Forecast revisions
MegaScale (Production)
ByteDance, 23 Feb 2024.
- Lab
- ByteDance
- Released
- 23 Feb 2024
- Kind
- Language, Language modeling/generation
- Training compute
- 3.9 × 10²⁴ FLOP
- Parameters
- 530.0 billion
- Organisations
- ByteDance, Peking University
- Country
- China
See it in the 3D sky Paper or announcement
Data: Epoch AI (Creative Commons Attribution), releases too new for it from OpenRouter, and METR. Updated 25 Sep 2026.