waypoints.si The sky Every system The lead Countries Forecast revisions
Transformer-XL Large + Phrase Induction
Massachusetts Institute of Technology (MIT), 4 Jun 2019.
- Lab
- Massachusetts Institute of Technology (MIT)
- Released
- 4 Jun 2019
- Kind
- Language, Language modeling/generation
- Training compute
- 3.8 × 10²⁰ FLOP
- Parameters
- 257.0 million
- Organisations
- Massachusetts Institute of Technology (MIT), University of Illinois Urbana-Champaign (UIUC)
- Country
- United States
Built on
- Transformer-XL (257M), 2019
See it in the 3D sky Paper or announcement
Data: Epoch AI (Creative Commons Attribution), releases too new for it from OpenRouter, and METR. Updated 25 Sep 2026.