waypoints.si The sky Every system The lead Countries Forecast revisions

Transformer-XL (257M)

Carnegie Mellon University (CMU), 9 Jan 2019.

Lab

Carnegie Mellon University (CMU)

Released

9 Jan 2019

Kind

Language, Language modeling/generation

Training compute

3.8 × 10²⁰ FLOP

Parameters

257.0 million

Organisations

Carnegie Mellon University (CMU), Google Brain

Country

United States

Built on it (1)

• Transformer-XL Large + Phrase Induction, 2019

See it in the 3D sky Paper or announcement

Data: Epoch AI (Creative Commons Attribution), releases too new for it from OpenRouter, and METR. Updated 25 Sep 2026.