waypoints.si The sky Every system The lead Countries Forecast revisions
DistilBERT
Other companies, 2 Oct 2019.
- Lab
- Other companies
- Released
- 2 Oct 2019
- Kind
- Language, Text autocompletion
- Training compute
- 1.2 × 10¹⁹ FLOP
- Parameters
- 66.0 million
- Organisations
- Hugging Face
- Country
- United States
See it in the 3D sky Paper or announcement
Data: Epoch AI (Creative Commons Attribution), releases too new for it from OpenRouter, and METR. Updated 25 Sep 2026.