waypoints.si The sky Every system The lead Countries Forecast revisions
Transformer (Adaptive Input Embeddings) WT103
Meta, 28 Sep 2018.
- Lab
- Meta
- Released
- 28 Sep 2018
- Kind
- Language, Language modeling
- Training compute
- 4.5 × 10¹⁹ FLOP
- Parameters
- 247.0 million
- Organisations
- Facebook AI Research
- Country
- United States
Built on it (1)
- base LM+GNN+kNN, 2021
See it in the 3D sky Paper or announcement
Data: Epoch AI (Creative Commons Attribution), releases too new for it from OpenRouter, and METR. Updated 25 Sep 2026.