waypoints.si The sky Every system The lead Countries Forecast revisions

GPT-2 Medium (FlashAttention)

Stanford University, 27 May 2022.

Lab
Stanford University
Released
27 May 2022
Kind
Language, Language modeling/generation
Training compute
8.9 × 10²⁰ FLOP
Parameters
355.0 million
Organisations
Stanford University, University at Buffalo
Country
United States

Data: Epoch AI (Creative Commons Attribution), releases too new for it from OpenRouter, and METR. Updated 25 Sep 2026.