waypoints.si The sky Every system The lead Countries Forecast revisions
GShard (dense)
Google, 30 Jun 2020.
- Lab
- Released
- 30 Jun 2020
- Kind
- Language, Translation
- Training compute
- 4.8 × 10²² FLOP
- Parameters
- 2.3 billion
- Organisations
- Country
- United States
See it in the 3D sky Paper or announcement
Data: Epoch AI (Creative Commons Attribution), releases too new for it from OpenRouter, and METR. Updated 25 Sep 2026.