waypoints.si The sky Every system The lead Countries Forecast revisions

Adaptive Input Transformer + RD

Microsoft, 28 Jun 2021.

Lab
Microsoft
Released
28 Jun 2021
Kind
Language, Language modeling
Training compute
8.5 × 10¹⁹ FLOP
Parameters
247.0 million
Organisations
Microsoft Research Asia, Soochow University
Country
China

Data: Epoch AI (Creative Commons Attribution), releases too new for it from OpenRouter, and METR. Updated 25 Sep 2026.