waypoints.si The sky Every system The lead Countries Forecast revisions
Mesh-TensorFlow Transformer 4.9B (language)
Google, 5 Nov 2018.
- Lab
- Released
- 5 Nov 2018
- Kind
- Language, Language modeling/generation
- Training compute
- 1.6 × 10²⁰ FLOP
- Parameters
- 4.9 billion
- Organisations
- Google Brain
- Country
- United States
See it in the 3D sky Paper or announcement
Data: Epoch AI (Creative Commons Attribution), releases too new for it from OpenRouter, and METR. Updated 25 Sep 2026.