waypoints.si The sky Every system The lead Countries Forecast revisions
Megatron-Turing NLG 530B
Microsoft, 11 Oct 2021.
- Lab
- Microsoft
- Released
- 11 Oct 2021
- Kind
- Language, Language modeling
- Training compute
- 8.5 × 10²³ FLOP
- Parameters
- 530.0 billion
- Organisations
- Microsoft, Nvidia
- Country
- United States
See it in the 3D sky Paper or announcement
Data: Epoch AI (Creative Commons Attribution), releases too new for it from OpenRouter, and METR. Updated 25 Sep 2026.