Back to the sky waypoints.si

Every notable AI system since 1950

1081 systems from 33 worlds, newest first. Data: Epoch AI, AI models dataset, Creative Commons Attribution licence. Updated 25 Sep 2026.

DateSystemWorldKindTraining compute
2026
23 Sep 2026Qwen3.8 Max Prime new sourceAlibabaLanguage
23 Sep 2026GLM 5.3 Prime new sourceZ.ai (Zhipu AI)Language
22 Sep 2026GPT-6 Sol Pro new sourceOpenAILanguage
22 Sep 2026GPT-6 Sol new sourceOpenAILanguage
22 Sep 2026GPT-6 Luna Pro new sourceOpenAILanguage
22 Sep 2026GPT-6 Luna new sourceOpenAILanguage
22 Sep 2026Claude Opus 5.5 new sourceAnthropicLanguage
21 Sep 2026Qwen3.8 Omni Flash new sourceAlibabaLanguage
21 Sep 2026Grok 4.7 sourcexAILanguage
18 Sep 2026Step 5 Preview sourceOther companiesLanguage
18 Sep 2026GLM 5.3 FlashX new sourceZ.ai (Zhipu AI)Language
9 Sep 2026DeepSeek V4.1 Flash sourceDeepSeekLanguage1024.6 FLOP
8 Sep 2026GPT-Image-2.5 Sunburst sourceOpenAIImage generation
8 Sep 2026GPT-Image-2.5 Flare sourceOpenAIImage generation
8 Sep 2026ChatGPT Images 2.5 sourceOpenAIImage generation
3 Sep 2026WeatherNext 3 sourceGoogle DeepMindEarth science1023.3 FLOP
3 Sep 2026OpenEvidence Darwin sourceOther groupsLanguage
3 Sep 2026GPT-6 AstraOpenAIMultimodal1027.0 FLOP
2 Sep 2026Muse Spark 1.3 sourceMetaLanguage
2 Sep 2026Gemini 3.8 Flash sourceGoogle DeepMindLanguage
1 Sep 2026Claude Fable 5.1 sourceAnthropicLanguage
28 Aug 2026Tencent Hy4 preview sourceOther companiesLanguage
20 Aug 2026GLM-5.3-Flash sourceZ.ai (Zhipu AI)Language1024.5 FLOP
19 Aug 2026GEN-1.5 sourceOther companiesRobotics
14 Aug 2026GLM-5.3 sourceZ.ai (Zhipu AI)Language
11 Aug 2026GPT-5.6 Cyber sourceOpenAICybersecurity
8 Aug 2026Qwen3.8-2.4T-A95B sourceAlibabaLanguage
7 Aug 2026Motif-3 sourceOther companiesLanguage1024.0 FLOP
5 Aug 2026Muse Spark 1.2 sourceMetaLanguage
31 Jul 2026K-EXAONE 2.0 sourceOther companiesLanguage1024.6 FLOP
29 Jul 2026A.X K2 sourceOther companiesLanguage1024.3 FLOP
24 Jul 2026Claude Opus 5 sourceAnthropicLanguage
19 Jul 2026Qwen 3.8 Max sourceAlibabaLanguage
16 Jul 2026Kimi K3 sourceMoonshotLanguage1025.3 FLOP
15 Jul 2026Inkling sourceOther companiesLanguage1024.3 FLOP
6 Jul 2026Tencent Hy3 sourceOther companiesLanguage
29 Jun 2026LongCat-2.0 sourceOther companiesLanguage1025.0 FLOP
28 Jun 2026Solar Open2 250B sourceOther companiesLanguage1024.0 FLOP
9 Jun 2026Claude Mythos 5 sourceAnthropicLanguage
9 Jun 2026Claude Fable 5 sourceAnthropicLanguage
4 Jun 2026Nemotron 3 Ultra sourceNvidiaLanguage1024.8 FLOP
3 Jun 2026Qwen3.7-Plus sourceAlibabaLanguage
2 Jun 2026MAI-Image-2.5 sourceMicrosoftImage generation
2 Jun 2026MAI-Code-1-Flash sourceMicrosoftLanguage
1 Jun 2026MiniMax-M3 sourceOther companiesLanguage
28 May 2026Claude Opus 4.8 sourceAnthropicLanguage
19 May 2026Gemini 3.5 Flash sourceGoogle DeepMindLanguage
18 May 2026Composer 2.5 sourceOther companiesLanguage1025.6 FLOP
11 May 2026TML-Interaction-Small sourceOther companiesLanguage
7 May 2026GPT-5.5 Cyber sourceOpenAICybersecurity
5 May 2026GPT-5.5 Instant sourceOpenAIMultimodal
24 Apr 2026DeepSeek-V4-Pro sourceDeepSeekLanguage1025.0 FLOP
24 Apr 2026DeepSeek-V4-Flash sourceDeepSeekLanguage1024.4 FLOP
23 Apr 2026Tencent Hy3 preview sourceOther companiesLanguage
23 Apr 2026MiMo-V2.5-Pro sourceOther companiesLanguage1024.8 FLOP
23 Apr 2026GPT-5.5 Pro sourceOpenAIMultimodal
23 Apr 2026GPT-5.5 sourceOpenAIMultimodal
21 Apr 2026GPT Image 2 sourceOpenAIImage generation
20 Apr 2026Kimi K2.6 sourceMoonshotLanguage
16 Apr 2026Claude Opus 4.7 sourceAnthropicLanguage
15 Apr 2026Gemini Flash 3.1 TTS sourceGoogle DeepMindAudio
14 Apr 2026GPT-5.4-Cyber sourceOpenAICybersecurity
9 Apr 2026EXAONE 4.5Other companiesLanguage1024.6 FLOP
8 Apr 2026Muse Spark sourceMetaMultimodal
7 Apr 2026GLM-5.1 sourceZ.ai (Zhipu AI)Language
7 Apr 2026Claude Mythos Preview sourceAnthropicLanguage
5 Apr 2026MolmoAct 2 sourceOther groupsVision1022.0 FLOP
1 Apr 2026Qwen 3.6 Plus sourceAlibabaLanguage
29 Mar 2026Qwen3.5-Omni-Plus sourceAlibabaLanguage
29 Mar 2026Qwen3.5-Omni-Flash sourceAlibabaLanguage
19 Mar 2026Composer 2 sourceOther companiesLanguage1025.4 FLOP
18 Mar 2026MiMo-V2-Pro sourceOther companiesLanguage
11 Mar 2026Nemotron 3 Super sourceNvidiaLanguage
5 Mar 2026GPT-5.4 Pro sourceOpenAIMultimodal
5 Mar 2026GPT-5.4 sourceOpenAIMultimodal
3 Mar 2026Gemini 3.0 Flash-lite sourceGoogle DeepMindLanguage
1 Mar 2026SWE 1.6 sourceOther companiesLanguage
24 Feb 2026Qwen3.5-122B-A10B sourceAlibabaLanguage
17 Feb 2026Grok 4.20 sourcexAILanguage
15 Feb 2026Qwen3.5 397B-A17B sourceAlibabaLanguage
12 Feb 2026Seedance 2.0 sourceByteDanceImage generation
12 Feb 2026GPT-5.3-Codex-Spark sourceOpenAILanguage
12 Feb 2026GLM-5 sourceZ.ai (Zhipu AI)Language1024.8 FLOP
5 Feb 2026GPT-5.3 Codex sourceOpenAILanguage
2 Feb 2026Qwen3-Coder-Next sourceAlibabaLanguage
2 Feb 2026Kimi K2.5 sourceMoonshotLanguage1024.8 FLOP
25 Jan 2026Qwen3-Max-Thinking sourceAlibabaLanguage
2025
31 Dec 2025Solar Open 100B sourceOther companiesLanguage1024.1 FLOP
31 Dec 2025K-EXAONE sourceOther companiesLanguage1024.2 FLOP
30 Dec 2025VAETKI sourceOther companiesLanguage
30 Dec 2025A.X K1 sourceOther companiesLanguage
29 Dec 2025HyperCLOVA X SEED 32B Think sourceOther companiesMultimodal
23 Dec 2025MiniMax-M2.1 sourceOther companiesLanguage
22 Dec 2025GLM-4.7 sourceZ.ai (Zhipu AI)Language1024.6 FLOP
18 Dec 2025GPT-5.2 Codex sourceOpenAILanguage
15 Dec 2025Nemotron 3-Nano-30B-A3B sourceNvidiaLanguage1023.7 FLOP
11 Dec 2025GPT-5.2 Pro sourceOpenAIMultimodal
11 Dec 2025GPT-5.2OpenAI
4 Dec 2025SIMA 2 sourceGoogle DeepMind3D modeling
27 Nov 2025DeepSeekMath-V2 sourceDeepSeekLanguage
24 Nov 2025Claude Opus 4.5 sourceAnthropicLanguage
20 Nov 2025Olmo 3 sourceOther groupsLanguage1024.0 FLOP
20 Nov 2025Gemini 3 Pro Image (Nano Banana Pro) sourceGoogle DeepMindImage generation
19 Nov 2025Grok 4.1 Fast sourcexAILanguage
19 Nov 2025GPT-5.1-Codex-Max sourceOpenAILanguage
18 Nov 2025Gemini 3 Pro sourceGoogle DeepMindMultimodal
18 Nov 2025Gemini 3 Deep Think sourceGoogle DeepMindLanguage
17 Nov 2025π0.6 (pi-0.6) sourceOther companiesRobotics
17 Nov 2025P1-235B-A22B sourceOther universitiesLanguage
17 Nov 2025Grok 4.1 sourcexAILanguage
13 Nov 2025GPT-5.1 Instant sourceOpenAIMultimodal
13 Nov 2025GPT-5.1 sourceOpenAIMultimodal
12 Nov 2025GPT-5.1-CodexOpenAILanguage
10 Nov 2025Meta's Generative Ads Model (GEM) sourceMetaRecommendation
7 Nov 2025Kaiju Small sourceOther companiesLanguage
7 Nov 2025Kaiju Medium sourceOther companiesLanguage
7 Nov 2025Kaiju Large sourceOther companiesLanguage
6 Nov 2025Kimi K2 Thinking sourceMoonshotLanguage1024.6 FLOP
28 Oct 2025Tongyi DeepResearch sourceAlibabaLanguage
27 Oct 2025MiniMax-M2 sourceOther companiesLanguage
15 Oct 2025Veo 3.1 sourceGoogle DeepMindVideo
15 Oct 2025Claude Haiku 4.5 sourceAnthropicLanguage
10 Oct 2025Ling-1T sourceOther companiesLanguage1024.8 FLOP
7 Oct 2025GPT-5 Pro sourceOpenAIMultimodal
30 Sep 2025Sora 2.0 sourceOpenAIVideo
30 Sep 2025GLM-4.6 sourceZ.ai (Zhipu AI)Language1024.6 FLOP
29 Sep 2025Claude Sonnet 4.5 sourceAnthropicLanguage
25 Sep 2025Gemini Robotics-ER 1.5 sourceGoogle DeepMindVision
22 Sep 2025Qwen3-Omni-30B-A3B sourceAlibabaMultimodal1022.6 FLOP
16 Sep 2025AgentFounder-30B sourceAlibabaLanguage1023.8 FLOP
5 Sep 2025Qwen3-Max sourceAlibabaLanguage1025.2 FLOP
1 Sep 2025LongCat-Flash sourceOther companiesLanguage1024.6 FLOP
26 Aug 2025Gemini 2.5 Flash Image (Nano Banana) sourceGoogleImage generation
7 Aug 2025GPT-5 nano sourceOpenAIMultimodal
7 Aug 2025GPT-5 mini sourceOpenAIMultimodal
7 Aug 2025GPT-5 sourceOpenAIMultimodal1025.8 FLOP
5 Aug 2025gpt-oss-20b sourceOpenAILanguage1023.7 FLOP
5 Aug 2025gpt-oss-120b sourceOpenAILanguage1024.7 FLOP
5 Aug 2025Claude Opus 4.1 sourceAnthropicLanguage
4 Aug 2025Qwen Image sourceAlibabaImage generation
4 Aug 2025Hierarchical Reasoning Model (HPM) sourceOther groupsLanguage
1 Aug 2025MindLink-72B sourceOther companiesLanguage
1 Aug 2025Gemini 2.5 Deep Think sourceGoogleLanguage
28 Jul 2025GLM-4.5 sourceZ.ai (Zhipu AI)Language1024.6 FLOP
25 Jul 2025Qwen3-235B-A22B-Thinking (Jul 2025) sourceAlibabaLanguage1024.7 FLOP
25 Jul 2025Qwen3-235B-A22B (Jul 2025) sourceAlibabaLanguage1024.7 FLOP
22 Jul 2025Qwen3-Coder-480B-A35B sourceAlibabaLanguage1024.2 FLOP
15 Jul 2025EXAONE 4.0 (32B) sourceOther companiesLanguage1024.4 FLOP
14 Jul 2025Gemini Embedding sourceGoogle DeepMindLanguage
11 Jul 2025Kimi K2 sourceMoonshotLanguage1024.5 FLOP
10 Jul 2025Grok 4 Heavy sourcexAILanguage
9 Jul 2025Grok 4 sourcexAILanguage1026.7 FLOP
9 Jul 2025EXAONE Path 2.0 sourceOther companiesVision
12 Jun 2025FGN sourceGoogle DeepMindEarth science1022.0 FLOP
11 Jun 2025Seed-1.6-Thinking sourceByteDanceMultimodal
5 Jun 2025Qwen3 Embedding sourceAlibabaLanguage
5 Jun 2025Gemini 2.5 Pro (Jun 2025) sourceGoogle DeepMindLanguage
28 May 2025DeepSeek-R1 (May 2025) sourceDeepSeekLanguage1024.6 FLOP
22 May 2025Claude Sonnet 4 sourceAnthropicLanguage
22 May 2025Claude Opus 4 sourceAnthropicLanguage
21 May 2025Veo 3 sourceGoogle DeepMindVideo
20 May 2025Imagen 4 sourceGoogleImage generation
11 May 2025Seed1.5-VL sourceByteDanceVision1024.1 FLOP
6 May 2025Gemini 2.5 Pro (May 2025) sourceGoogle DeepMindLanguage
29 Apr 2025Qwen3-235B-A22B sourceAlibabaLanguage1024.7 FLOP
23 Apr 2025gpt-image-1 sourceOpenAIImage generation
10 Apr 2025Pangu Ultra sourceOther companiesLanguage1025.0 FLOP
5 Apr 2025Llama 4 Scout sourceMetaMultimodal1024.6 FLOP
5 Apr 2025Llama 4 Maverick sourceMetaMultimodal1024.4 FLOP
5 Apr 2025Llama 4 Behemoth (preview) sourceMetaMultimodal1025.7 FLOP
27 Mar 2025GPT-4o (Mar 2025) sourceOpenAIMultimodal
25 Mar 2025Gemini 2.5 Pro (Mar 2025) sourceGoogle DeepMindLanguage
24 Mar 2025DeepSeek-V3 (Mar 2025) sourceDeepSeekLanguage1024.5 FLOP
22 Mar 2025Diffusion Renderer sourceNvidiaVideo
19 Mar 2025o1-pro sourceOpenAILanguage
16 Mar 2025EXAONE Deep 32B sourceOther companiesLanguage1024.1 FLOP
16 Mar 2025ERNIE-4.5-VL-424B-A47B (文心大模型4.5) sourceBaiduMultimodal
11 Mar 2025Hunyuan-TurboS sourceOther companiesLanguage1024.7 FLOP
6 Mar 2025QwQ-32B sourceAlibabaLanguage1024.6 FLOP
6 Mar 2025Mistral OCR sourceMistral AIMultimodal
27 Feb 2025Mercury sourceOther companiesLanguage
27 Feb 2025GPT-4.5 sourceOpenAILanguage1026.6 FLOP
24 Feb 2025Claude 3.7 Sonnet sourceAnthropicLanguage1025.5 FLOP
17 Feb 2025Grok 3 sourcexAILanguage1026.5 FLOP
31 Jan 2025o3-mini sourceOpenAILanguage
29 Jan 2025GPT-4o (Jan 2025) sourceOpenAIMultimodal
23 Jan 2025Computer-Using Agent (CUA) sourceOpenAIVision
22 Jan 2025Kimi k1.5 sourceMoonshotMultimodal
22 Jan 2025Doubao-1.5-pro sourceByteDanceLanguage
20 Jan 2025Eagle 2NvidiaVision1022.7 FLOP
20 Jan 2025DeepSeek-R1 sourceDeepSeekLanguage1024.5 FLOP
17 Jan 2025INTELLECT-MATH sourceOther companiesMathematics
8 Jan 2025Stable Point Aware 3D (SPAR3D) sourceOther companies3D modeling
2 Jan 2025Eurus-2-7B-PRIME sourceTsinghua UniversityMathematics1020.6 FLOP
2024
31 Dec 2024STORM-B/8 sourceOther universities3D modeling
24 Dec 2024DeepSeek-V3 sourceDeepSeekLanguage1024.5 FLOP
20 Dec 2024o3 sourceOpenAILanguage
16 Dec 2024Veo 2 sourceGoogle DeepMindVideo
13 Dec 2024Apollo 7B sourceMetaMultimodal
11 Dec 2024Gemini 2.0 Pro sourceGoogle DeepMindLanguage
9 Dec 2024Sora Turbo sourceOpenAIVideo
9 Dec 2024EXAONE 3.5 32B sourceOther companiesLanguage1024.1 FLOP
6 Dec 2024Llama 3.3 70B sourceMetaLanguage1024.8 FLOP
5 Dec 2024o1 sourceOpenAILanguage
5 Dec 2024NVILA 15B sourceNvidiaVision
5 Dec 2024Infinity sourceByteDanceImage generation
3 Dec 2024Amazon Nova Pro sourceOther companiesMultimodal1024.8 FLOP
25 Nov 2024Fugatto 1 sourceNvidiaMultimodal
20 Nov 2024GPT-4o (Nov 2024) sourceOpenAIMultimodal
19 Nov 2024Suno v4 sourceOther companiesAudio
18 Nov 2024Pixtral Large sourceMistral AIMultimodal
16 Nov 2024k0-math sourceMoonshotMathematics
15 Nov 2024Gemini-Exp-1114 sourceGoogle DeepMindLanguage
11 Nov 2024SeedEdit sourceByteDanceVision
6 Nov 2024Hunyuan-Large sourceOther companiesLanguage1024.5 FLOP
28 Oct 2024Doubao-pro sourceByteDanceLanguage1025.4 FLOP
22 Oct 2024NVLM-X 72B sourceNvidiaVision1024.5 FLOP
22 Oct 2024NVLM-H 72B sourceNvidiaVision1024.5 FLOP
22 Oct 2024NVLM-D 72B sourceNvidiaVision1024.5 FLOP
16 Oct 2024Yi-Lightning sourceOther companiesLanguage1024.2 FLOP
15 Oct 2024CHAI-1 sourceOther companiesBiology1021.9 FLOP
12 Oct 2024Llama-3.1-Nemotron-70B-Instruct sourceNvidiaLanguage1024.9 FLOP
10 Oct 2024RDT-1B sourceTsinghua UniversityRobotics1022.6 FLOP
9 Oct 2024Palmyra X 004 sourceOther companiesLanguage
8 Oct 2024GR-2 sourceByteDanceRobotics
4 Oct 2024Movie Gen Video sourceMetaVideo1024.2 FLOP
24 Sep 2024PixelDance sourceByteDanceVideo
24 Sep 2024Llama 3.2 11B sourceMetaMultimodal1023.8 FLOP
20 Sep 2024Telechat2-115B sourceOther companiesLanguage1024.8 FLOP
19 Sep 2024Qwen2.5-72B sourceAlibabaLanguage1024.9 FLOP
19 Sep 2024Qwen2.5 Instruct (72B) sourceAlibabaLanguage1024.9 FLOP
19 Sep 2024Oryx 34B sourceTsinghua UniversityMultimodal
17 Sep 2024Qwen2.5-32B sourceAlibabaLanguage1024.6 FLOP
12 Sep 2024o1-preview sourceOpenAILanguage
12 Sep 2024o1-mini sourceOpenAILanguage
6 Sep 2024DeepSeek-V2.5 sourceDeepSeekLanguage1024.2 FLOP
5 Sep 2024Hunyuan Turbo sourceOther companiesLanguage
5 Sep 2024Harrison.rad.1 sourceOther companiesVision
5 Sep 2024AlphaProteo sourceGoogle DeepMindBiology
29 Aug 2024Hairuo sourceOther companiesLanguage
29 Aug 2024GLM-4-Plus sourceZ.ai (Zhipu AI)Language
22 Aug 2024Jamba 1.5-Large sourceOther companiesLanguage
13 Aug 2024Grok-2 sourcexAILanguage1025.5 FLOP
7 Aug 2024Table Tennis Agent sourceGoogle DeepMindRobotics
6 Aug 2024LLaVA-OV-72B sourceByteDanceMultimodal1024.5 FLOP
6 Aug 2024GPT-4o (Aug 2024) sourceOpenAIMultimodal
29 Jul 2024AFM-server sourceOther companiesLanguage1024.6 FLOP
29 Jul 2024AFM-on-device sourceOther companiesLanguage1023.6 FLOP
24 Jul 2024Mistral Large 2 sourceMistral AILanguage
23 Jul 2024Llama 3.1-405B sourceMetaLanguage1025.6 FLOP
18 Jul 2024GPT-4o mini sourceOpenAILanguage
16 Jul 2024Mathstral sourceMistral AIMathematics
16 Jul 2024DeepL LLM sourceOther companiesLanguage
6 Jul 2024SenseChat 5.5 sourceOther companiesMultimodal
28 Jun 2024Ernie 4.0 Turbo sourceBaiduMultimodal
25 Jun 2024ESM3 (98B) sourceOther companiesBiology1024.0 FLOP
24 Jun 2024Cambrian-1-34B sourceNew York University (NYU)Multimodal
20 Jun 2024Claude 3.5 Sonnet sourceAnthropicMultimodal1025.4 FLOP
17 Jun 2024DeepSeek-Coder-V2 236B sourceDeepSeekLanguage1024.1 FLOP
14 Jun 2024Nemotron-4 340B sourceNvidiaLanguage1025.3 FLOP
13 Jun 2024OpenVLA sourceStanford UniversityRobotics1023.0 FLOP
7 Jun 2024Qwen2-72B sourceAlibabaLanguage1024.5 FLOP
21 May 2024ALLaM adapted 70B sourceOther companiesLanguage1024.0 FLOP
20 May 2024Octo-Base sourceUniversity of California (UC) BerkeleyRobotics1020.8 FLOP
20 May 2024GLM-4 (0520) sourceZ.ai (Zhipu AI)Language
13 May 2024Yi-LargeOther companiesLanguage1024.3 FLOP
13 May 2024GPT-4o sourceOpenAIMultimodal
8 May 2024AlphaFold 3 sourceGoogle DeepMindBiology1022.6 FLOP
3 May 2024VILA1.5-13B sourceNvidiaMultimodal1021.4 FLOP
1 May 2024GenCast sourceGoogle DeepMindEarth science1020.9 FLOP
18 Apr 2024Llama 3-70B sourceMetaLanguage1024.9 FLOP
15 Apr 2024Reka Core sourceOther companiesMultimodal1024.9 FLOP
9 Apr 2024GPT-4 Turbo (Apr 2024) sourceOpenAIMultimodal
29 Mar 2024ReALM sourceOther companiesLanguage
27 Mar 2024DBRX sourceOther companiesLanguage1024.4 FLOP
14 Mar 2024MM1-30B sourceOther companiesMultimodal1023.7 FLOP
13 Mar 2024ManiGaussian sourceTsinghua UniversityRobotics
7 Mar 2024Inflection-2.5 sourceOther companiesLanguage1024.9 FLOP
4 Mar 2024Claude 3 Sonnet sourceAnthropicMultimodal
4 Mar 2024Claude 3 Opus sourceAnthropicMultimodal
4 Mar 2024Aramco Metabrain AI sourceOther companiesLanguage1025.0 FLOP
26 Feb 2024Mistral Large sourceMistral AILanguage
23 Feb 2024MegaScale (Production) sourceByteDanceLanguage1024.6 FLOP
22 Feb 2024Stable Diffusion 3 sourceOther companiesImage generation1022.7 FLOP
15 Feb 2024Sora sourceOpenAIVideo
15 Feb 2024Gemini 1.5 Pro sourceGoogle DeepMindLanguage
12 Feb 2024Aya sourceOther companiesLanguage
4 Feb 2024Qwen1.5-72B sourceAlibabaLanguage1024.1 FLOP
25 Jan 2024Qwen-VL-Max sourceAlibabaMultimodal
17 Jan 2024AlphaGeometry sourceGoogle DeepMindMathematics
1 Jan 2024Palmyra X 003 sourceOther companiesLanguage
1 Jan 2024Kimi Explorer sourceMoonshotLanguage
2023
29 Dec 2023CoRe sourceTsinghua UniversityMathematics
23 Dec 2023GQA-8-XXL sourceGoogleLanguage1022.5 FLOP
21 Dec 2023nekomata-14b sourceOther companiesLanguage1023.4 FLOP
19 Dec 2023Gemini Nano-2 sourceGoogle DeepMindMultimodal
19 Dec 2023Gemini Nano-1 sourceGoogle DeepMindMultimodal
14 Dec 2023FunSearch sourceGoogle DeepMindLanguage1023.6 FLOP
14 Dec 2023CogAgent sourceTsinghua UniversityVision1022.8 FLOP
12 Dec 2023VILA-13B sourceNvidiaMultimodal1021.4 FLOP
11 Dec 2023W.A.L.T sourceStanford UniversityVideo
11 Dec 2023Mixtral 8x7B sourceMistral AILanguage1023.9 FLOP
8 Dec 2023SeamlessM4T sourceMetaSpeech
7 Dec 2023Llama Guard sourceMetaLanguage1023.2 FLOP
6 Dec 2023Gemini 1.0 Ultra sourceGoogle DeepMindMultimodal1025.7 FLOP
6 Dec 2023Gemini 1.0 Pro sourceGoogle DeepMindMultimodal
1 Dec 2023Mamba-24M (SC09) sourceCarnegie Mellon University (CMU)Speech
30 Nov 2023Qwen-72B sourceAlibabaLanguage1024.1 FLOP
29 Nov 2023PPLX-70B-Online sourceOther companiesLanguage
29 Nov 2023GNoME for crystal discovery sourceGoogle DeepMindMaterials science
22 Nov 2023Inflection-2 sourceOther companiesLanguage1025.0 FLOP
21 Nov 2023Claude 2.1 sourceAnthropicLanguage
16 Nov 2023AndesGPT sourceOther companiesLanguage
15 Nov 2023Nemotron-3-8B sourceNvidiaLanguage1023.3 FLOP
14 Nov 2023Qwen-Audio-Chat sourceAlibabaLanguage
14 Nov 2023GraphCast sourceGoogle DeepMindEarth science1022.3 FLOP
13 Nov 2023Volcano 13B sourceOther universitiesLanguage1022.7 FLOP
13 Nov 2023SPHINX (Llama 2 13B) sourceOther universitiesVision1022.5 FLOP
8 Nov 2023RoFormer sourceOther companiesLanguage1018.3 FLOP
8 Nov 2023MultiBand Diffusion sourceMetaAudio1019.4 FLOP
7 Nov 2023mPLUG-Owl2 sourceAlibabaVision
7 Nov 2023OmniVec sourceOther companiesMultimodal
6 Nov 2023GPT-4 Turbo (Nov 2023) sourceOpenAIMultimodal
6 Nov 2023CogVLM-17B sourceTsinghua UniversityMultimodal1022.8 FLOP
5 Nov 2023LLaVA 1.5 sourceOther universitiesMultimodal1022.9 FLOP
4 Nov 2023Grok-1 sourcexAILanguage1024.5 FLOP
3 Nov 2023RT-Trajectory sourceGoogle DeepMindRobotics
3 Nov 2023BLUUMI sourceOther universitiesLanguage
2 Nov 2023Yi-34B sourceOther companiesLanguage1023.8 FLOP
2 Nov 2023Cohere Embed sourceOther companiesLanguage
30 Oct 2023Skywork-13B sourceOther companiesLanguage1023.4 FLOP
27 Oct 2023ChatGLM3-6B sourceZ.ai (Zhipu AI)Multimodal1022.7 FLOP
26 Oct 2023DiT-XL/2 + CADS sourceOther universitiesImage generation
26 Oct 2023CODEFUSION (Python) sourceMicrosoftLanguage1018.9 FLOP
19 Oct 2023DALL·E 3 sourceOpenAIImage generation
17 Oct 2023PaLI-3 sourceGoogle DeepMindMultimodal
17 Oct 2023ERNIE 4.0 sourceBaiduMultimodal
13 Oct 2023RT-2-X sourceGoogle DeepMindRobotics
11 Oct 2023Ferret (13B) sourceOther universitiesMultimodal
9 Oct 2023RoseTTAFold All-Atom (RFAA) sourceUniversity of WashingtonBiology1020.3 FLOP
7 Oct 2023FinGPT-13B sourceOther universitiesLanguage1023.2 FLOP
1 Oct 2023CTM (CIFAR-10) sourceStanford UniversityImage generation
28 Sep 2023GPT-3.5 Turbo Instruct sourceOpenAILanguage
28 Sep 2023Amazon Titan sourceOther companiesLanguage1024.7 FLOP
27 Sep 2023Show-1 sourceOther universitiesVideo
25 Sep 2023GPT-4V sourceOpenAIMultimodal
22 Sep 2023AlphaMissense sourceGoogle DeepMindBiology
12 Sep 2023Robot Parkour sourceOther universitiesRobotics
6 Sep 2023Falcon-180B sourceOther groupsLanguage1024.6 FLOP
30 Aug 2023Swift sourceOther companiesRobotics1016.7 FLOP
29 Aug 2023Jais sourceOther companiesLanguage1022.7 FLOP
28 Aug 2023PeptideBERT sourceCarnegie Mellon University (CMU)Biology1016.7 FLOP
24 Aug 2023Qwen-VL sourceAlibabaMultimodal
5 Aug 2023GGNN sourceOther universitiesBiology1021.9 FLOP
28 Jul 2023RT-2 sourceGoogle DeepMindRobotics
26 Jul 2023AudioLM sourceGoogleAudio1018.6 FLOP
18 Jul 2023Llama 2-7B sourceMetaLanguage1022.9 FLOP
18 Jul 2023Llama 2-70B sourceMetaLanguage1023.9 FLOP
18 Jul 2023GPT3-2.7B (FlashAttention-2) sourceStanford UniversityLanguage
11 Jul 2023Claude 2 sourceAnthropicLanguage1024.6 FLOP
6 Jul 2023xTrimoPGLM -100B sourceTsinghua UniversityBiology1023.8 FLOP
6 Jul 2023InternLM sourceOther universitiesLanguage1024.0 FLOP
5 Jul 2023Pangu-Weather sourceOther companiesEarth science1022.6 FLOP
4 Jul 2023Stable Diffusion XL (SDXL) sourceOther companiesImage generation
27 Jun 2023HyenaDNA sourceStanford UniversityBiology1021.3 FLOP
27 Jun 2023ERNIE 3.5BaiduLanguage
13 Jun 2023GPT-4 (Jun 2023) sourceOpenAIMultimodal1025.3 FLOP
13 Jun 2023GPT-3.5 Turbo sourceOpenAILanguage
8 Jun 2023MusicGen sourceMetaAudio
6 Jun 2023LTM-1 sourceOther companiesLanguage
29 May 2023PaLI-X sourceGoogleMultimodal1023.8 FLOP
29 May 2023DPO on Pythia-2.8B sourceStanford UniversityLanguage
23 May 2023Goat-7B sourceOther universitiesLanguage
20 May 2023CodeT5+ sourceSalesforceLanguage
18 May 2023ONE-PEACE sourceAlibabaMultimodal1020.3 FLOP
17 May 2023CoEdiT-xxl sourceOther universitiesLanguage
16 May 2023Med-PaLM 2 sourceGoogleMedicine
11 May 2023InstructBLIP sourceSalesforceMultimodal1020.3 FLOP
10 May 2023PaLM 2 sourceGoogleLanguage1024.9 FLOP
9 May 2023StarCoder sourceOther companiesLanguage1022.9 FLOP
9 May 2023ImageBind sourceMetaMultimodal
26 Apr 2023Agile Soccer Robot sourceGoogle DeepMindRobotics
17 Apr 2023LLaVA sourceOther universitiesMultimodal1022.9 FLOP
14 Apr 2023DINOv2 sourceMetaVision1021.9 FLOP
9 Apr 2023Incoder-6.7B sourceMetaLanguage1021.5 FLOP
5 Apr 2023Segment Anything Model sourceMetaVision1021.9 FLOP
30 Mar 2023BloombergGPT sourceOther companiesLanguage1023.4 FLOP
29 Mar 2023VideoMAE V2 sourceOther universitiesVideo1022.0 FLOP
27 Mar 2023SigLIP 400M sourceGoogle DeepMindVision1021.7 FLOP
21 Mar 2023Firefly sourceOther companiesImage generation
20 Mar 2023PanGu-Σ sourceOther companiesLanguage1023.7 FLOP
20 Mar 2023Gen-2 sourceOther companiesVideo
15 Mar 2023LEP-AD sourceOther universitiesBiology
15 Mar 2023GPT-4 (Mar 2023) sourceOpenAIMultimodal1025.3 FLOP
15 Mar 2023Falcon-40B sourceOther groupsLanguage1023.4 FLOP
14 Mar 2023Claude sourceAnthropicLanguage
6 Mar 2023PaLM-E sourceGoogleRobotics
5 Mar 2023AudioGen sourceMetaAudio1022.0 FLOP
2 Mar 2023DiT-XL/2 sourceNew York University (NYU)Image generation1020.8 FLOP
24 Feb 2023LLaMA-65B sourceMetaLanguage1023.7 FLOP
13 Feb 2023BASIC-L + Lion sourceGoogleVision
10 Feb 2023ViT-22B sourceGoogleVision1023.3 FLOP
9 Feb 2023ProteinDT sourceUniversity of California (UC) BerkeleyBiology
6 Feb 2023Gen-1 sourceOther companiesVideo
30 Jan 2023BLIP-2 (Q-Former) sourceSalesforceVision1021.1 FLOP
27 Jan 2023DDPM-IP (CelebA) sourceOther universitiesImage generation1020.5 FLOP
26 Jan 2023MusicLM sourceGoogleAudio
16 Jan 2023Ankh_large sourceOther universitiesBiology1021.8 FLOP
15 Jan 2023Nucleotide Transformer sourceNvidiaBiology1021.9 FLOP
10 Jan 2023DreamerV3 sourceDeepMindGames1020.3 FLOP
5 Jan 2023VALL-E sourceMicrosoftAudio1019.0 FLOP
2022
28 Dec 2022Hybrid H3-2.7B sourceStanford UniversityLanguage1021.8 FLOP
19 Dec 2022CaLM sourceUniversity of OxfordBiology1019.5 FLOP
13 Dec 2022RT-1 sourceGoogleRobotics
10 Dec 2022TranceptEve sourceUniversity of OxfordBiology
4 Dec 2022Vega v2 sourceOther universitiesLanguage1022.9 FLOP
1 Dec 2022DeepNash sourceDeepMindGames
28 Nov 2022Discriminator Guidance sourceOther universitiesImage generation1020.3 FLOP
28 Nov 2022DiT-XL/2 + Discriminator Guidance sourceOther universitiesImage generation
28 Nov 2022ALM 1.0 sourceOther universitiesLanguage
22 Nov 2022CICERO sourceMetaGames
20 Nov 2022AR-LDM sourceAlibabaImage generation1020.7 FLOP
18 Nov 2022Fusion in Encoder sourceOther companiesLanguage1020.1 FLOP
16 Nov 2022Galactica sourceMetaLanguage1023.5 FLOP
14 Nov 2022EVA-01 sourceOther universitiesVision1022.2 FLOP
12 Nov 2022AltCLIP_M9 sourceOther universitiesMultimodal
10 Nov 2022InternImage sourceOther universitiesVision1021.4 FLOP
3 Nov 2022mT0-13B sourceOther companiesLanguage
3 Nov 2022Mogrifier RLSTM (WT2) sourceDeepMindLanguage1017.1 FLOP
2 Nov 2022eDiff-I sourceNvidiaImage generation1019.7 FLOP
24 Oct 2022EnCodec sourceMetaAudio
20 Oct 2022U-PaLM (540B) sourceGoogleLanguage1024.4 FLOP
20 Oct 2022LMSI-Palm sourceGoogleLanguage
20 Oct 2022Flan-PaLM 540B sourceGoogleLanguage1024.4 FLOP
11 Oct 2022GenSLM sourceOther universitiesBiology1021.1 FLOP
11 Oct 2022Diplodocus sourceMetaGames
5 Oct 2022Phenaki sourceOther universitiesVideo
5 Oct 2022AlphaTensor sourceDeepMindOther1020.9 FLOP
4 Oct 2022DiffDock sourceMassachusetts Institute of Technology (MIT)Biology1019.9 FLOP
29 Sep 2022Make-A-Video sourceMetaVideo
21 Sep 2022Whisper sourceOpenAISpeech1021.6 FLOP
14 Sep 2022SauTech sourceOther companiesSpeech
14 Sep 2022PaLI sourceGoogleLanguage1023.2 FLOP
22 Aug 2022BEIT-3 sourceMicrosoftMultimodal1019.9 FLOP
10 Aug 2022BlenderBot 3 sourceOther universitiesLanguage1023.6 FLOP
4 Aug 2022GLM-130B sourceTsinghua UniversityLanguage1023.6 FLOP
2 Aug 2022AlexaTM 20B sourceOther companiesLanguage1023.3 FLOP
22 Jul 2022OmegaPLM sourceMassachusetts Institute of Technology (MIT)Biology1022.0 FLOP
21 Jul 2022ESM2-15B sourceMetaBiology1022.9 FLOP
11 Jul 2022BLOOM-176B sourceOther companiesLanguage1023.6 FLOP
6 Jul 2022NLLB sourceMetaLanguage1022.2 FLOP
5 Jul 2022CodeT5-large sourceSalesforceLanguage1021.4 FLOP
29 Jun 2022Minerva (540B) sourceGoogleLanguage1024.4 FLOP
27 Jun 2022ProGen2-xlarge sourceSalesforceBiology1022.1 FLOP
22 Jun 2022Parti sourceGoogleImage generation1023.7 FLOP
14 Jun 2022CoCa sourceGoogleVision1022.9 FLOP
13 Jun 2022MetaLM sourceMicrosoftMultimodal
6 Jun 2022DITTO sourceTsinghua UniversityLanguage1018.5 FLOP
5 Jun 2022Diffusion-GAN sourceOther universitiesImage generation
29 May 2022CogVideo sourceTsinghua UniversityVideo
27 May 2022Tranception sourceUniversity of OxfordBiology1021.9 FLOP
27 May 2022GPT-2 Medium (FlashAttention) sourceStanford UniversityLanguage1020.9 FLOP
23 May 2022Imagen sourceGoogleImage generation1022.2 FLOP
18 May 2022SimCSE sourceOther universitiesLanguage
12 May 2022Gato sourceDeepMindMultimodal1021.6 FLOP
10 May 2022UL2 sourceGoogleLanguage1023.1 FLOP
4 May 2022DeBERTaV3large + KEAR sourceMicrosoftLanguage
2 May 2022OPT-175B sourceMetaLanguage1023.6 FLOP
29 Apr 2022Flamingo sourceDeepMindMultimodal1023.3 FLOP
14 Apr 2022XMC-GAN sourceGoogleImage generation
14 Apr 2022Sparse all-MLP sourceMetaLanguage1020.7 FLOP
13 Apr 2022Stable Diffusion (LDM-KL-8-G) sourceOther companiesImage generation1022.7 FLOP
7 Apr 2022BERT-RBP sourceOther universitiesBiology1020.1 FLOP
6 Apr 2022DALL·E 2 sourceOpenAIImage generation1023.5 FLOP
4 Apr 2022PaLM (540B) sourceGoogleLanguage1024.4 FLOP
29 Mar 2022Chinchilla sourceDeepMindLanguage1023.8 FLOP
24 Mar 2022Make-A-Scene sourceMetaImage generation1021.8 FLOP
21 Mar 2022Segatron-XL large, M=384 + HCP sourceMicrosoftLanguage1019.4 FLOP
15 Mar 2022GPT-3.5 (davinci-002) sourceOpenAILanguage1024.4 FLOP
10 Mar 2022ViT-G (model soup) sourceUniversity of WashingtonVision1021.5 FLOP
7 Mar 2022MegaSyn sourceOther companiesMedicine
2 Mar 2022Statement Curriculum Learning sourceOpenAILanguage1022.2 FLOP
1 Mar 2022DeepNet sourceMicrosoftLanguage
26 Feb 2022PolyCoder sourceCarnegie Mellon University (CMU)Language1021.0 FLOP
22 Feb 2022FourCastNet sourceNvidiaEarth science1020.5 FLOP
17 Feb 2022ST-MoE sourceGoogleLanguage1023.5 FLOP
15 Feb 2022Midjourney V1Other companiesImage generation
10 Feb 2022ProteinBERT sourceOther universitiesBiology1019.8 FLOP
10 Feb 2022LaMDA sourceGoogleLanguage1023.6 FLOP
9 Feb 2022GPT-NeoX-20B sourceOther groupsLanguage1023.0 FLOP
8 Feb 2022MaskGIT (ImageNet) sourceGoogleImage generation
7 Feb 2022RETRO-7B sourceDeepMindLanguage1022.2 FLOP
2 Feb 2022AlphaCode sourceDeepMindLanguage1023.4 FLOP
27 Jan 2022InstructGPT 6B sourceOpenAILanguage
27 Jan 2022InstructGPT 175B sourceOpenAILanguage1023.5 FLOP
27 Jan 2022InstructGPT 1.3B sourceOpenAILanguage
23 Jan 2022OntoProtein sourceOther universitiesBiology
22 Jan 2022AbLang (heavy sequences) sourceUniversity of OxfordBiology
20 Jan 2022data2vec (vision) sourceMetaVision
20 Jan 2022data2vec (speech) sourceMetaSpeech
20 Jan 2022data2vec (language) sourceMetaLanguage
7 Jan 2022Detic sourceMetaVision1019.4 FLOP
2021
31 Dec 2021ERNIE-ViLG sourceBaiduMultimodal
23 Dec 2021ERNIE 3.0 Titan sourceBaiduLanguage1024.0 FLOP
20 Dec 2021XGLM-7.5B sourceMetaLanguage1022.4 FLOP
20 Dec 2021LDM-1.45B sourceOther universitiesImage generation
16 Dec 2021Contriever sourceMetaLanguage1020.2 FLOP
15 Dec 2021LongT5 sourceGoogleLanguage
13 Dec 2021GLaM sourceGoogleLanguage1023.6 FLOP
8 Dec 2021Gopher (280B) sourceDeepMindLanguage1023.8 FLOP
6 Dec 2021Student of Games sourceDeepMindGames1022.6 FLOP
3 Dec 2021T-NLRv5 XXL sourceMicrosoftLanguage
24 Nov 2021NÜWA sourceMicrosoftMultimodal1021.9 FLOP
22 Nov 2021Florence sourceMicrosoftVision1022.7 FLOP
19 Nov 2021BASIC-L sourceGoogleVision1022.6 FLOP
18 Nov 2021Swin Transformer V2 (SwinV2-G) sourceMicrosoftVision1021.0 FLOP
17 Nov 2021AliceMind-MMU sourceAlibaba
15 Nov 2021ViT-G/14 (LiT) sourceGoogleVision
11 Nov 2021Masked Autoencoders ViT-H sourceMetaVision1020.7 FLOP
1 Nov 2021Projected GAN sourceOther universitiesImage generation1019.0 FLOP
1 Nov 2021CodeT5-base sourceSalesforceLanguage1021.2 FLOP
31 Oct 2021S4 sourceStanford UniversityLanguage1019.9 FLOP
30 Oct 2021EfficientZero sourceTsinghua UniversityGames
27 Oct 2021Eve sourceOther universitiesBiology
17 Oct 2021base LM+GNN+kNN sourceOther companiesLanguage1019.7 FLOP
12 Oct 2021Yuan 1.0 sourceOther companiesLanguage1023.6 FLOP
11 Oct 2021Megatron-Turing NLG 530B sourceMicrosoftLanguage1023.9 FLOP
4 Oct 2021AlphaFold-Multimer sourceGoogle DeepMindBiology1021.6 FLOP
28 Sep 2021Turing ULRv5 sourceMicrosoftLanguage1022.5 FLOP
21 Sep 2021TrOCR sourceOther universitiesVision
20 Sep 2021PLATO-XL sourceBaiduLanguage1022.0 FLOP
10 Sep 2021HyperCLOVA 204B sourceOther companiesLanguage1023.3 FLOP
6 Sep 2021PermuteFormer sourceOther universitiesLanguage1018.4 FLOP
4 Sep 2021MEB sourceMicrosoftSearch
3 Sep 2021FLAN 137B sourceGoogleLanguage1024.3 FLOP
17 Aug 2021XLMR-XXL sourceMetaLanguage1022.5 FLOP
15 Aug 2021DNABERT sourceOther universitiesBiology1020.0 FLOP
11 Aug 2021Zidong Taichu sourceOther universitiesMultimodal1020.9 FLOP
11 Aug 2021Jurassic-1-Jumbo sourceOther companiesLanguage1023.6 FLOP
7 Aug 2021W2v-BERT sourceGoogleSpeech
6 Aug 2021YOLOX-X sourceOther companiesVision1020.8 FLOP
3 Aug 20216-Act Tether sourceMetaRobotics
29 Jul 2021SEER sourceMetaVision1022.3 FLOP
27 Jul 2021HuBERT sourceMetaSpeech1021.7 FLOP
27 Jul 2021GOAT sourceDeepMindGames1022.4 FLOP
7 Jul 2021Codex sourceOpenAILanguage1022.9 FLOP
5 Jul 2021ERNIE 3.0 sourceBaiduLanguage1022.4 FLOP
28 Jun 2021Adaptive Input Transformer + RD sourceMicrosoftLanguage1019.9 FLOP
24 Jun 2021Fold2Seq sourceIBMBiology1017.1 FLOP
23 Jun 2021EfficientNetV2-XL sourceGoogleVision1020.0 FLOP
21 Jun 2021StyleGAN3-T sourceNvidiaImage generation1021.2 FLOP
21 Jun 2021StyleGAN3-R sourceNvidiaImage generation1021.4 FLOP
11 Jun 2021Denoising Diffusion Probabilistic Models (LSUN Bedroom) sourceUniversity of California (UC) BerkeleyVision1019.9 FLOP
11 Jun 2021ALIGN sourceGoogleMultimodal1022.4 FLOP
10 Jun 2021DeBERTa sourceMicrosoftLanguage1022.4 FLOP
9 Jun 2021EMDR sourceOther universitiesLanguage1021.3 FLOP
9 Jun 2021CoAtNet sourceGoogleVision1022.6 FLOP
8 Jun 2021ViT-G/14 sourceGoogleVision1022.8 FLOP
28 May 2021ByT5-XXL sourceGoogleLanguage1022.9 FLOP
26 May 2021Transformer local-attention (NesT-B) sourceGoogleVision1019.4 FLOP
26 May 2021CogView sourceTsinghua UniversityImage generation1022.4 FLOP
20 May 2021MedBERT sourceOther universitiesMedicine1019.0 FLOP
11 May 2021ADM sourceOpenAIImage generation1021.8 FLOP
4 May 2021ProtT5-XL-U50 sourceOther universitiesBiology1022.3 FLOP
4 May 2021ProtBERT-BFD sourceOther universitiesBiology1022.6 FLOP
19 Apr 2021PLUG sourceAlibabaLanguage1022.6 FLOP
24 Mar 2021Unicorn sourceOther groupsLanguage
5 Mar 2021M6-T sourceAlibabaMultimodal1021.7 FLOP
5 Mar 2021Generative BST sourceMetaLanguage1022.2 FLOP
1 Mar 2021Meta Pseudo Labels sourceGoogleVision1022.7 FLOP
24 Feb 2021SRU++ Large sourceOther companiesLanguage1019.3 FLOP
18 Feb 2021Rational DQN Average sourceOther universitiesGames
13 Feb 2021MSA Transformer sourceMetaBiology1021.7 FLOP
9 Feb 2021top-down frozen classifier sourceUniversity of EdinburghSpeech
9 Feb 2021DLWP sourceUniversity of WashingtonEarth science1018.8 FLOP
15 Jan 2021DeiT-B sourceMetaVision1019.9 FLOP
11 Jan 2021Switch sourceGoogleLanguage1022.9 FLOP
10 Jan 2021BigSSL sourceGoogleSpeech
5 Jan 2021DALL-E sourceOpenAIImage generation1022.7 FLOP
5 Jan 2021CLIP (ViT L/14@336px) sourceOpenAIMultimodal1022.0 FLOP
5 Jan 2021CLIP (ResNet-50) sourceOpenAIMultimodal
2020
31 Dec 2020ERNIE-Doc (247M) sourceBaiduLanguage1019.5 FLOP
25 Dec 2020CT-MoS (WT2) sourceGoogleLanguage1017.7 FLOP
23 Dec 2020DensePhrases sourceOther universitiesLanguage1018.3 FLOP
17 Dec 2020VQGAN + CLIP sourceOther universitiesImage generation
15 Dec 2020ESM1b sourceMetaBiology1021.7 FLOP
1 Dec 2020CPM-Large sourceTsinghua UniversityLanguage1020.4 FLOP
30 Nov 2020AlphaFold 2 sourceDeepMindBiology1021.5 FLOP
23 Nov 2020KEPLER sourceTsinghua UniversityLanguage1021.2 FLOP
22 Oct 2020wave2vec 2.0 LARGE sourceMetaSpeech1021.6 FLOP
22 Oct 2020ViT-Huge/14 sourceGoogleVision1021.6 FLOP
22 Oct 2020ViT-Base/32 sourceGoogleVision
21 Oct 2020German ELECTRA Large sourceOther companiesLanguage1021.1 FLOP
20 Oct 2020mT5-XXL sourceGoogleLanguage1022.9 FLOP
20 Oct 2020Conformer + Wav2vec 2.0 + Noisy Student sourceGoogleSpeech1021.9 FLOP
2 Oct 2020LUKE sourceUniversity of WashingtonLanguage1022.3 FLOP
1 Sep 2020ProBERTa sourceOther universitiesBiology1019.0 FLOP
6 Aug 2020ERNIE-GEN (large) sourceBaiduLanguage1020.3 FLOP
3 Aug 2020DeLighT sourceUniversity of WashingtonLanguage1018.6 FLOP
27 Jul 2020EfficientDet sourceGoogleVision
16 Jul 2020Hopfield Networks (2020) sourceOther universitiesBiology
2 Jul 2020SemExp sourceCarnegie Mellon University (CMU)Robotics
30 Jun 2020GShard (dense) sourceGoogleLanguage1022.7 FLOP
28 May 2020GPT-3 175B (davinci) sourceOpenAILanguage1023.5 FLOP
26 May 2020DETR sourceMetaVision1020.6 FLOP
22 May 2020Retrieval-Augmented Generator sourceMetaLanguage
16 May 2020Conformer sourceGoogleSpeech
7 May 2020ContextNet sourceGoogleSpeech
6 May 2020NAS+ESS (23M) sourceOther universitiesLanguage
2 May 2020UnifiedQA sourceOther groupsLanguage1019.2 FLOP
29 Apr 2020Once for All sourceOther universitiesVision1020.8 FLOP
27 Apr 2020Go-explore sourceOther companiesGames
8 Apr 2020CURL sourceUniversity of California (UC) BerkeleyGames
30 Mar 2020Agent57 sourceDeepMindGames
24 Mar 2020MetNet sourceGoogleEarth science1019.0 FLOP
23 Mar 2020ELECTRA sourceStanford UniversityLanguage1021.5 FLOP
17 Mar 2020Tensor-Transformer(1core)+PN (WT103) sourceUniversity of California (UC) BerkeleyLanguage1018.2 FLOP
12 Mar 2020Routing Transformer (WT-103) sourceGoogleLanguage
11 Mar 2020TransformerXL + spectrum control sourceOther universitiesLanguage1019.4 FLOP
28 Feb 2020TCAN (WT2) sourceOther universitiesLanguage
21 Feb 2020Feedback Transformer sourceOther universitiesLanguage1018.9 FLOP
14 Feb 2020FFN SwiGLU sourceGoogleLanguage1019.5 FLOP
13 Feb 2020Turing-NLG sourceMicrosoftLanguage1022.2 FLOP
13 Feb 2020SimCLR sourceGoogleVision
9 Feb 2020ALBERT-xxlarge sourceOther universitiesLanguage1021.4 FLOP
8 Feb 2020TaLK Convolution sourceOther universitiesLanguage1019.4 FLOP
8 Feb 2020Perceiver IO (optical flow) sourceDeepMindMultimodal
7 Feb 2020Theseus 6/768 sourceOther universitiesLanguage
28 Jan 2020Meena sourceGoogleLanguage1023.1 FLOP
19 Jan 2020ContextNet + Noisy Student sourceGoogleSpeech1021.9 FLOP
15 Jan 2020AlphaFold sourceDeepMindBiology1020.0 FLOP
2019
24 Dec 2019Big Transfer (BiT-L) sourceGoogleVision
19 Dec 2019DD-PPO sourceOther universitiesRobotics1020.9 FLOP
13 Dec 2019OpenAI Five Rerun sourceOpenAIGames1022.1 FLOP
13 Dec 2019OpenAI Five sourceOpenAIGames1022.8 FLOP
5 Dec 2019MMLSTM (WT-2)Other universitiesLanguage1017.3 FLOP
5 Dec 2019MMLSTM (PTB)Other universitiesLanguage1016.8 FLOP
4 Dec 2019StarGAN v2 sourceOther companiesVision
3 Dec 2019StyleGAN2 sourceNvidiaImage generation
27 Nov 2019Transformer-XL DeFINE (141M) sourceUniversity of WashingtonLanguage1018.2 FLOP
25 Nov 2019Photo-Geometric Autoencoder sourceUniversity of Oxford3D modeling
19 Nov 2019Transformer - LibriVox + Decoding/Rescoring sourceMetaSpeech
19 Nov 2019MuZero sourceDeepMindGames1019.7 FLOP
13 Nov 2019MoCo sourceMetaVision
11 Nov 2019Noisy Student (L2) sourceCarnegie Mellon University (CMU)Vision1022.4 FLOP
10 Nov 2019Sandwich Transformer sourceOther groupsLanguage1019.4 FLOP
10 Nov 2019CamemBERT sourceMetaLanguage1020.9 FLOP
5 Nov 2019XLM-RoBERTa sourceMetaLanguage1022.3 FLOP
1 Nov 2019Base LM + kNN LM + Continuous Cache sourceStanford UniversityLanguage1019.5 FLOP
30 Oct 2019AlphaStar sourceDeepMindGames1023.0 FLOP
29 Oct 2019BART-large sourceMetaLanguage
23 Oct 2019T5-3B sourceGoogleLanguage1021.9 FLOP
23 Oct 2019T5-11B sourceGoogleLanguage1022.5 FLOP
11 Oct 2019M4-50B sourceGoogleLanguage
2 Oct 2019DistilBERT sourceOther companiesLanguage1019.1 FLOP
2 Oct 2019AlphaX-1 sourceMetaVision1017.9 FLOP
26 Sep 2019ALBERT sourceOther universitiesLanguage
25 Sep 2019Adaptive Inputs + LayerDrop sourceMetaLanguage
17 Sep 2019Megatron-LM (8.3B) sourceNvidiaLanguage1022.0 FLOP
17 Sep 2019Megatron-LM (1.2B) sourceNvidiaLanguage1021.1 FLOP
17 Sep 2019Megatron-BERT sourceNvidiaLanguage1022.3 FLOP
4 Sep 2019UDSMProt sourceOther groupsBiology1017.8 FLOP
4 Sep 2019Mogrifier (d2, MoS2, MC) + dynamic eval sourceDeepMindLanguage
22 Aug 2019trRosetta sourceOther universitiesBiology1019.6 FLOP
22 Jul 2019EN^2AS with performance reward sourceOther universitiesLanguage
11 Jul 2019Pluribus sourceMetaGames1016.8 FLOP
4 Jul 2019BigBiGAN sourceGoogleVision
1 Jul 2019RoBERTa Large sourceMetaLanguage1021.9 FLOP
19 Jun 2019Walking Minotaur robot sourceUniversity of California (UC) BerkeleyRobotics
17 Jun 2019LaNet-L (CIFAR-10) sourceOther universitiesVision
15 Jun 2019PG-SWGAN sourceOther universitiesImage generation
14 Jun 2019FixRes ResNeXt-101 WSL sourceMetaVision
13 Jun 2019Char-CNN-BiLSTM sourceOther companiesLanguage
10 Jun 2019AWD-LSTM + MoS + Partial Shuffled sourceOther universitiesLanguage1017.5 FLOP
4 Jun 2019Transformer-XL Large + Phrase Induction sourceMassachusetts Institute of Technology (MIT)Language1020.6 FLOP
1 Jun 2019XLNet sourceCarnegie Mellon University (CMU)Language1021.8 FLOP
1 Jun 2019XLM sourceMetaLanguage
31 May 2019DLRM-2020 sourceMetaRecommendation1018.6 FLOP
28 May 2019EfficientNet-L2 sourceGoogleVision
22 May 2019CPC v2 sourceDeepMindVision
14 May 2019AWD-LSTM-DRILL + dynamic evaluation† (WT2) sourceOther universitiesLanguage1017.6 FLOP
2 May 2019ResNeXt-101 Billion-scale sourceMetaVision
2 May 2019RaptorX-Contact sourceOther universitiesBiology
26 Apr 2019Neuro-Symbolic Concept Learner sourceMassachusetts Institute of Technology (MIT)Vision
25 Apr 2019MuseNet sourceOpenAIAudio1020.3 FLOP
20 Apr 2019BERT-Large-CAS (PTB+WT2+WT103) sourceOther companiesLanguage1020.2 FLOP
17 Apr 2019Transformer-XL + RMS dynamic eval sourceUniversity of EdinburghLanguage
8 Apr 2019WeNet (Penn Treebank) sourceOther companiesLanguage1017.9 FLOP
8 Apr 2019True-Regularization+Finetune+Dynamic-Eval sourceOther companiesLanguage
4 Apr 2019Cross-lingual alignment sourceOther universitiesLanguage1018.4 FLOP
26 Mar 2019SciBERT sourceOther groupsLanguage1019.9 FLOP
28 Feb 2019NMT Transformer 437M sourceGoogleLanguage
27 Feb 2019KataGo sourceOther companiesGames1019.4 FLOP
14 Feb 2019GPT-2 (1.5B) sourceOpenAILanguage1021.3 FLOP
9 Feb 2019SDE sourceCarnegie Mellon University (CMU)Language
1 Feb 2019Hanabi 4 player sourceDeepMindGames1018.6 FLOP
31 Jan 2019MT-DNN sourceMicrosoftLanguage
9 Jan 2019Transformer-XL (257M) sourceCarnegie Mellon University (CMU)Language1020.6 FLOP
1 Jan 2019Transformer ELMo sourceOther groupsLanguage
2018
12 Dec 2018StyleGAN sourceNvidiaImage generation1016.6 FLOP
4 Dec 2018SPN (ImageNet 128) sourceGoogleImage generation
16 Nov 2018GPipe (Transformer) sourceGoogleLanguage
15 Nov 2018Multi-cell LSTM sourceOther universitiesLanguage1015.3 FLOP
12 Nov 2018Fine-tuned-AWD-LSTM-DOC (fin) sourceOther companiesLanguage1016.7 FLOP
5 Nov 2018Mesh-TensorFlow Transformer 4.9B (language) sourceGoogleLanguage1020.2 FLOP
5 Nov 2018Mesh-TensorFlow Transformer 2.9B (translation) sourceGoogleLanguage1019.8 FLOP
31 Oct 2018MemoReader sourceOther companiesLanguage
15 Oct 2018TrellisNet sourceCarnegie Mellon University (CMU)Language1018.4 FLOP
11 Oct 2018MetaMimic sourceGoogleRobotics
11 Oct 2018BERT-Large sourceGoogleLanguage1020.4 FLOP
28 Sep 2018Transformer (Adaptive Input Embeddings) WT103 sourceMetaLanguage1019.6 FLOP
24 Sep 2018LSTM+NeuralCache sourceOther universitiesLanguage1015.0 FLOP
18 Sep 2018AWD-LSTM-MoS + dynamic evaluation (WT2, 2018) sourceOther universitiesLanguage
17 Sep 2018Transformer + Simple Recurrent Unit sourceOther companiesLanguage1019.0 FLOP
10 Sep 2018NetSurfP-2.0 sourceOther universitiesBiology
30 Aug 2018(ensemble): AWD-LSTM-DOC (fin) × 5 (WT2) sourceOther companiesLanguage1017.8 FLOP
28 Aug 2018Big Transformer for Back-Translation sourceMetaLanguage1020.7 FLOP
14 Aug 2018AWD-LSTM-MoS+PDR + dynamic evaluation (WT2) sourceIBMLanguage
10 Jul 2018Big-Little Net (speech) sourceIBMSpeech1017.6 FLOP
10 Jul 2018Big-Little Net sourceIBMVision1017.4 FLOP
3 Jul 2018FTW (For The Win) sourceDeepMindGames1019.5 FLOP
18 Jun 2018MobileNetV2 sourceGoogleVision
5 Jun 2018Relational Memory Core sourceDeepMindLanguage
1 Jun 2018GPT-1 sourceOpenAILanguage1019.2 FLOP
22 May 2018aLSTM(depth-2)+RecurrentPolicy (WT2) sourceOther universitiesLanguage1016.9 FLOP
3 May 2018Dropout-LSTM+Noise(Bernoulli) (WT2) sourceOther universitiesLanguage1017.1 FLOP
2 May 2018ResNeXt-101 32x48d sourceMetaVision1021.9 FLOP
8 Apr 2018YOLOv3 sourceUniversity of WashingtonVision1019.1 FLOP
22 Mar 20184 layer QRNN (h=2500) sourceSalesforceLanguage1017.8 FLOP
1 Mar 2018Chinese - English translation sourceMicrosoftLanguage
15 Feb 2018TCN (P-MNIST) sourceCarnegie Mellon University (CMU)Vision
7 Feb 2018DeepLabV3+ sourceGoogleVision
5 Feb 2018IMPALA sourceDeepMindGames1020.2 FLOP
1 Feb 2018QRNN sourceSalesforceLanguage1017.8 FLOP
1 Feb 2018ELMo sourceUniversity of WashingtonLanguage1015.5 FLOP
30 Jan 2018T-DMCA sourceGoogleLanguage
2017
5 Dec 2017AlphaZero sourceDeepMindGames1020.0 FLOP
1 Dec 2017DL scaling speech sourceBaiduSpeech
1 Dec 2017DL scaling LM sourceBaiduLanguage
1 Dec 2017DL scaling Image sourceBaiduVision
21 Nov 2017TriNet sourceOther universitiesVideo
10 Nov 2017AWD-LSTM-MoS + dynamic evaluation (WT2, 2017) sourceCarnegie Mellon University (CMU)Language1018.5 FLOP
2 Nov 2017VQ-VAE sourceDeepMindVision
31 Oct 2017Fraternal dropout + AWD-LSTM 3-layer (WT2) sourceOther universitiesLanguage1017.5 FLOP
31 Oct 2017DCN+ sourceSalesforceLanguage
29 Oct 2017S-Norm sourceUniversity of WashingtonLanguage
28 Oct 2017PhraseCond sourceCarnegie Mellon University (CMU)Language
27 Oct 2017ProgressiveGAN sourceNvidiaVision
19 Oct 2017AlphaGo Master sourceDeepMindGames1020.5 FLOP
18 Oct 2017AlphaGo Zero sourceDeepMindGames1020.8 FLOP
6 Oct 2017Rainbow DQN sourceDeepMindGames
26 Sep 2017AWD-LSTM+WT+Cache+IOG (WT2) sourceOther companiesLanguage1015.5 FLOP
21 Sep 2017LSTM + dynamic eval sourceUniversity of EdinburghLanguage
15 Sep 2017ISS sourceOther universitiesLanguage1015.5 FLOP
6 Sep 2017PyramidNet sourceOther universitiesVision1015.4 FLOP
5 Sep 2017SENet (ImageNet) sourceOther universitiesVision
29 Aug 2017GL-LWGC-AWD-MoS-LSTM + dynamic evaluation (WT2) sourceOther universitiesLanguage1017.7 FLOP
19 Aug 2017Libratus sourceCarnegie Mellon University (CMU)Games1020.7 FLOP
16 Aug 2017NeuMF (Pinterest) sourceOther universitiesRecommendation
14 Aug 2017EI-REHN-1000D sourceOther universitiesLanguage1016.0 FLOP
11 Aug 2017OpenAI TI7 DOTA 1v1 sourceOpenAIGames1020.8 FLOP
7 Aug 2017RetinaNet-R50 sourceMetaVision
7 Aug 2017RetinaNet-R101 sourceMetaVision1018.3 FLOP
7 Aug 2017AWD-LSTM - 3-layer LSTM (tied) + continuous cache pointer (WT2) sourceSalesforceLanguage1017.5 FLOP
30 Jul 2017GSM sourceOther universitiesLanguage
25 Jul 2017ConvS2S (ensemble of 8 models) sourceMetaLanguage1019.8 FLOP
21 Jul 2017PSPNet sourceOther universitiesVision
21 Jul 2017NASNet-A sourceGoogleVision
18 Jul 2017AWD-LSTM sourceDeepMindLanguage
10 Jul 2017JFT sourceGoogleVision1020.9 FLOP
7 Jul 2017DeepLoc sourceOther universitiesBiology1017.8 FLOP
3 Jul 2017ShuffleNet v1 sourceOther companiesVision
30 Jun 2017NoisyNet-Dueling sourceDeepMindGames
17 Jun 2017DeepLabV3 sourceGoogleVision
13 Jun 2017HRA sourceOther companiesGames
12 Jun 2017Transformer sourceGoogleLanguage1018.9 FLOP
10 Jun 2017EDSR sourceOther universitiesVision
8 Jun 2017Reading Twice for NLU sourceDeepMindLanguage
7 Jun 2017PointNet++ sourceStanford University3D modeling
1 Jun 2017Inflated 3D ConvNet sourceDeepMind3D modeling
25 May 2017SRGAN sourceOther companiesVision
8 May 2017Mnemonic Reader sourceOther universitiesLanguage
27 Apr 2017DeepLab (2017) sourceOther universitiesVision
17 Apr 2017MobileNet sourceGoogleVision
31 Mar 2017WGAN-GP sourceOther universitiesImage generation
30 Mar 2017Mask R-CNN sourceMetaVision
15 Mar 2017Prototypical networks sourceUniversity of TorontoVision
1 Feb 2017DnCNN sourceOther universitiesVision
23 Jan 2017MoE-Multi sourceOther universitiesLanguage1020.0 FLOP
7 Jan 2017OR-WideResNet sourceOther universitiesVision
6 Jan 2017DeepStack sourceOther universitiesGames1019.2 FLOP
2016
25 Dec 2016YOLOv2 sourceUniversity of WashingtonVision
23 Dec 2016EnhanceNet sourceOther universitiesVision1017.1 FLOP
15 Dec 20163DMM-CNN sourceOther universitiesVision
13 Dec 2016HR-ResNet101 sourceCarnegie Mellon University (CMU)Vision1018.9 FLOP
5 Dec 2016GAN-Advancer sourceOpenAIVision
2 Dec 2016PointNet sourceStanford University3D modeling
2 Dec 2016Elastic weight consolidation sourceDeepMindVision
21 Nov 2016Image-to-image cGAN sourceUniversity of California (UC) BerkeleyVision
17 Nov 2016PolyNet sourceOther universitiesVision1019.8 FLOP
16 Nov 2016ResNeXt-50 sourceOther universitiesVision
16 Nov 2016ResNeXt-101 (64×4d) sourceOther universitiesVision1019.1 FLOP
16 Nov 2016DAC-CSR sourceOther universitiesVision
7 Nov 2016DTN (Domain Transfer Network) sourceMetaVision
6 Nov 2016DLDL (PASCAL) sourceUniversity of OxfordVision
5 Nov 2016NASv3 (CIFAR-10) sourceGoogleVision1021.3 FLOP
5 Nov 2016NAS with base 8 and shared embeddings sourceGoogleLanguage1016.0 FLOP
5 Nov 2016BIDAF sourceUniversity of WashingtonLanguage1018.5 FLOP
4 Nov 2016VD-LSTM+REAL Large sourceSalesforceLanguage1016.3 FLOP
28 Oct 2016SPIDER2 sourceOther universitiesBiology1016.3 FLOP
8 Oct 2016GAWWN sourceOther universitiesVision
7 Oct 2016Xception sourceGoogleVision1020.6 FLOP
26 Sep 2016Pointer Sentinel-LSTM (medium) sourceOther companiesLanguage1015.9 FLOP
26 Sep 2016GNMT sourceGoogleLanguage1021.8 FLOP
19 Sep 2016Wide Residual Network sourceOther universitiesVision
17 Sep 2016ResNet-200 sourceMicrosoftVision1019.5 FLOP
17 Sep 2016ResNet-1001 sourceMicrosoftVision
15 Sep 2016Youtube recommendation model sourceGoogleRecommendation
12 Sep 2016WaveNet sourceGoogle DeepMindSpeech
12 Sep 2016MS-ensemble-speech-recognition sourceMicrosoftSpeech
8 Sep 2016LF-MMI sourceOther universitiesSpeech
25 Aug 2016DenseNet-264 sourceTsinghua UniversityVision
22 Aug 2016SimpleNet sourceOther companiesVision
15 Jul 2016Character-enriched word2vec sourceMetaLanguage
27 Jun 2016CCL sourceOther companiesVision
21 Jun 2016R-FCN sourceTsinghua UniversityVision1017.9 FLOP
20 Jun 2016Segmental RNN sourceUniversity of EdinburghSpeech
17 Jun 2016CMS-RCNN sourceOther companiesVision
16 Jun 2016PixelCNN sourceGoogle DeepMindVision
8 May 2016LRR-4X sourceOther universitiesVision
30 Apr 2016Gated HORNN (3rd order) sourceOther universitiesLanguage
5 Apr 2016Dueling DQN sourceGoogle DeepMindGames
12 Mar 2016Template Adaptation sourceUniversity of OxfordVision
4 Mar 2016Named Entity Recognition model sourceCarnegie Mellon University (CMU)Language1017.0 FLOP
2 Mar 2016Double DQN sourceGoogle DeepMindGames
24 Feb 2016SqueezeNet sourceOther universitiesVision
23 Feb 2016Inceptionv4 sourceGoogleVision
23 Feb 2016Inception-ResNet-V2 sourceGoogleVision
4 Feb 2016A3C FF hsGoogleGames
27 Jan 2016AlphaGo Lee sourceDeepMindGames1021.3 FLOP
2015
16 Dec 2015Variational (untied weights, MC) LSTM (Large) sourceOther universitiesLanguage1015.8 FLOP
15 Dec 2015Advantage LearningGoogle DeepMindGames
10 Dec 2015ResNet-152 (ImageNet) sourceMicrosoftVision1019.0 FLOP
10 Dec 2015ResNet-110 (CIFAR-10) sourceMicrosoftVision
10 Dec 2015ResNet-101 (ImageNet) sourceMicrosoftVision1018.9 FLOP
8 Dec 2015SSD sourceOther groupsVision
2 Dec 2015Inception v3 sourceGoogleVision1020.0 FLOP
1 Dec 2015Netflix Recommender System sourceOther companiesRecommendation
23 Nov 2015Multi-scale Dilated CNN sourceOther universitiesVision
23 Nov 20153DDFA sourceOther universitiesVision
28 Oct 2015SAF R-CNN sourceOther universitiesVision1019.1 FLOP
1 Oct 2015AlphaGo Fan sourceDeepMindGames1020.6 FLOP
9 Sep 2015Deep Deterministic Policy Gradients sourceGoogle DeepMindRobotics
31 Aug 2015BPE sourceUniversity of EdinburghLanguage
7 Aug 2015DCNN sourceOther universitiesVision1017.7 FLOP
26 Jul 2015Deep CNN + COTS sourceOther companiesVision
19 Jul 2015CompACT-Deep sourceOther universitiesVision
15 Jun 2015BatchNorm sourceGoogleVision
8 Jun 2015YOLO sourceUniversity of WashingtonVision
7 Jun 2015CFSS sourceOther companiesVision
4 Jun 2015Faster R-CNN sourceMicrosoftVision
18 May 2015U-Net sourceOther universitiesVision1016.7 FLOP
30 Apr 2015Fast R-CNN sourceMicrosoftVision
6 Apr 2015TC-DNN-BLSTM-DNN sourceCarnegie Mellon University (CMU)Speech1017.3 FLOP
17 Mar 2015genCNN + dyn eval sourceOther universitiesLanguage1016.5 FLOP
25 Feb 2015DQN-2015 sourceGoogleGames
19 Feb 2015TRPO sourceUniversity of California (UC) BerkeleyGames
6 Feb 2015MSRA (C, PReLU) sourceMicrosoftVision1019.4 FLOP
1 Jan 2015VGG-Face sourceUniversity of OxfordVision
2014
22 Dec 2014ADAM (CIFAR-10) sourceOther universitiesVision1014.8 FLOP
18 Dec 2014Fractional Max-Pooling sourceOther universitiesVision1017.0 FLOP
3 Dec 2014SNM-skip sourceGoogleLanguage1020.5 FLOP
29 Nov 2014TA-CNN sourceOther universitiesVision1016.0 FLOP
28 Nov 2014Cascaded LNet-ANet sourceOther universitiesVision
14 Nov 2014Fully Convolutional Networks sourceUniversity of California (UC) BerkeleyVision
10 Nov 2014SC-NLM sourceUniversity of TorontoMultimodal
7 Nov 2014LRCN sourceOther universitiesVideo
23 Sep 2014Spatially-Sparse CNN sourceOther universitiesVision
18 Sep 2014Deeply-supervised nets sourceMicrosoftVision
17 Sep 2014GoogLeNet / InceptionV1 sourceGoogleVision1018.2 FLOP
14 Sep 2014SPN-4+KN5 sourceOther universitiesLanguage1016.6 FLOP
10 Sep 2014Seq2Seq LSTM sourceGoogleLanguage1019.8 FLOP
4 Sep 2014VGG19 sourceUniversity of OxfordVision1019.0 FLOP
4 Sep 2014VGG16 sourceUniversity of OxfordVision1019.1 FLOP
1 Sep 2014RNNsearch-50* sourceOther universitiesLanguage1018.2 FLOP
6 Aug 2014NPD sourceOther companiesVision
15 Jul 2014ACF-WIDER sourceOther universitiesVision1013.9 FLOP
1 Jul 2014SmooCT sourceOther universitiesGames1016.8 FLOP
23 Jun 2014Multiresolution CNN sourceGoogleVideo
23 Jun 2014DeepFace sourceOther universitiesVision
22 Jun 2014RNN-WER sourceDeepMindSpeech
21 Jun 2014Fragment embedding sourceStanford UniversityVision
18 Jun 2014SPPNet sourceMicrosoftVision1018.5 FLOP
10 Jun 2014GANs sourceUniversity of Montreal / Université de MontréalImage generation1017.7 FLOP
9 Jun 2014Two-stream ConvNets for action recognition sourceUniversity of OxfordVideo
3 Jun 2014GRUs sourceUniversity of Montreal / Université de MontréalLanguage
1 Jun 2014Dropout: SVHN sourceUniversity of TorontoVision
1 Jun 2014AdaRNN sourceOther universitiesLanguage
14 May 2014Paragraph Vector sourceGoogleLanguage
5 Mar 2014HyperNEAT sourceOther universitiesGames
1 Jan 2014GloVe (6B) sourceStanford UniversityLanguage
1 Jan 2014GloVe (32B) sourceStanford UniversityLanguage
2013
21 Dec 2013OverFeat sourceNew York University (NYU)Vision
20 Dec 2013Image generation sourceOther universitiesVision1014.7 FLOP
19 Dec 2013DQN sourceDeepMindGames1015.4 FLOP
16 Dec 2013Network in Network sourceOther universitiesVision
11 Dec 2013RNN for 1B words sourceGoogleLanguage
5 Dec 2013TransE sourceOther universitiesLanguage1018.1 FLOP
5 Dec 2013DeViSE sourceGoogleVision
12 Nov 2013Visualizing CNNs sourceNew York University (NYU)Vision1017.7 FLOP
11 Nov 2013R-CNN (T-net) sourceUniversity of California (UC) BerkeleyVision
16 Oct 2013Word2Vec (small) sourceGoogleLanguage
16 Oct 2013Word2Vec (large) sourceGoogleLanguage1016.6 FLOP
1 Oct 2013RNTN sourceStanford UniversityLanguage1016.1 FLOP
1 Oct 2013RCTM sourceUniversity of OxfordLanguage1016.0 FLOP
1 Aug 2013Hierarchical Scene Labeling (Stanford Background) sourceNew York University (NYU)Vision1017.4 FLOP
26 May 2013ReLU-Speech sourceGoogleSpeech1017.1 FLOP
26 May 2013Multilingual DNN sourceGoogleSpeech
2 Apr 2013Selective Search sourceOther universitiesVision
22 Mar 2013PreTrans-3L-250H sourceUniversity of TorontoSpeech
16 Jan 2013DistBelief NNLM sourceGoogleLanguage1018.4 FLOP
2012
3 Dec 2012DistBelief Vision sourceGoogleVision
3 Dec 2012DistBelief Speech sourceGoogleSpeech1017.5 FLOP
3 Dec 2012DNN EM segmentation sourceOther universitiesVision1017.7 FLOP
2 Dec 2012Bayesian automated hyperparameter tuning sourceUniversity of TorontoOther
1 Dec 2012RNN+LDA+KN5+cache sourceMicrosoftLanguage
30 Sep 2012AlexNet sourceUniversity of TorontoVision1017.7 FLOP
9 Sep 2012LSTM LM sourceOther universitiesLanguage1016.2 FLOP
27 Jul 2012Context-dependent RNN sourceMicrosoftLanguage
12 Jul 2012Unsupervised High-level Feature Learner sourceGoogleVision1017.8 FLOP
3 Jun 2012Dropout (TIMIT) sourceUniversity of TorontoSpeech
3 Jun 2012Dropout (MNIST) sourceUniversity of TorontoVision1015.8 FLOP
3 Jun 2012Dropout (ImageNet) sourceUniversity of TorontoVision1017.4 FLOP
3 Jun 2012Dropout (CIFAR) sourceUniversity of TorontoVision1015.6 FLOP
2011
8 Nov 2011NLP from scratch sourceOther companiesLanguage
3 Oct 2011CNN committee (traffic sign) sourceOther universitiesVision1015.0 FLOP
3 Oct 2011Adaptive Subgrad sourceOther universitiesLanguage
18 Sep 2011CNN Committee (NIST) sourceOther universitiesVision1016.4 FLOP
18 Sep 2011CNN Committee (MNIST) sourceOther universitiesVision1016.7 FLOP
16 Jul 2011High Performance CNN (NORB) sourceOther universitiesVision1016.4 FLOP
28 Jun 2011Recursive Neural Network sourceStanford UniversityVision
19 Jun 2011Vector Space Model sourceStanford UniversityLanguage
19 Jun 2011Cross-Lingual POS Tagger sourceCarnegie Mellon University (CMU)Language
29 Apr 2011Deep Autoencoders sourceUniversity of TorontoVision1016.6 FLOP
13 Apr 2011Deep rectifier networks sourceUniversity of Montreal / Université de MontréalVision
2010
26 Sep 2010YouTube Video Recommendation System sourceGoogleRecommendation
26 Sep 2010RNN LM sourceOther universitiesLanguage1016.7 FLOP
15 Sep 2010Pooling CNN (NORB) sourceOther universitiesVision1015.2 FLOP
15 Sep 2010Pooling CNN (Caltech 101) sourceOther universitiesVision1015.1 FLOP
15 Jun 2010ReLU (NORB) sourceUniversity of TorontoVision
15 Jun 2010ReLU (LFW) sourceUniversity of TorontoVision
13 Jun 2010iCCCP sourceMassachusetts Institute of Technology (MIT)Vision1015.0 FLOP
13 May 2010Feedforward NN sourceUniversity of Montreal / Université de MontréalVision1014.5 FLOP
3 Jan 2010Stacked Denoising Autoencoders sourceUniversity of Montreal / Université de MontréalOther
1 Jan 2010Super-vector codingOther universitiesVision
2009
22 Nov 2009LCNP NORB sourceOther groupsVision1015.4 FLOP
22 Nov 2009LCNP MNIST sourceOther groupsVision1015.6 FLOP
22 Nov 2009LCNP LabelMe sourceOther universitiesVision1015.5 FLOP
21 Sep 2009BellKor 2007 sourceAT&TRecommendation
1 Sep 2009Two Stage Feature Extraction (MNIST) sourceNew York University (NYU)Vision1013.3 FLOP
7 Aug 2009MatrixFac for Recommenders sourceOther companiesRecommendation
1 Aug 2009Pragmatic Theory solution (Netflix 2009) sourceOther companiesRecommendation
1 Aug 2009BigChaos OptiBlend sourceAT&TRecommendation
1 Aug 2009BellKor 2009 sourceAT&TRecommendation
1 Aug 2009BellKor 2008 sourceAT&TRecommendation
15 Jun 2009GPU DBNs sourceStanford UniversityOther1015.0 FLOP
8 Apr 2009RBM Image Classifier sourceUniversity of TorontoVision
1 Jan 2009BP-DBN sourceUniversity of TorontoSpeech
2008
9 Dec 2008GNN sourceOther universitiesOther109.2 FLOP
8 Dec 2008HLBL sourceUniversity of TorontoLanguage
25 Nov 2008BigChaos 2008 sourceAT&TRecommendation
19 Nov 2008Sparse digit recognition SVM sourceOther universitiesVision
5 Jul 2008Denoising Autoencoders sourceUniversity of Montreal / Université de MontréalOther
5 Jul 2008Deep Multitask NLP Network sourceOther companiesLanguage
2007
3 Dec 2007BLSTM for handwriting (2) sourceOther universitiesVision
28 Oct 2007Enhanced Neighborhood-Based Filtering sourceAT&TRecommendation
23 Sep 2007BLSTM for handwriting (1) sourceOther universitiesVision
22 Jun 2007SB-LM sourceGoogleLanguage1018.2 FLOP
22 Jun 2007KN-LM sourceGoogleLanguage1017.9 FLOP
1 Jun 2007λ-WASP sourceOther universitiesLanguage
2006
4 Dec 2006Greedy layer-wise DNN training sourceUniversity of Montreal / Université de MontréalOther
1 Dec 2006Local Binary Patterns for facial recognitionOther universitiesVision
18 Jul 2006Dimensionality Reduction sourceUniversity of TorontoVision
18 Jul 2006Deep Belief Nets sourceUniversity of TorontoVision
17 Jun 2006Spatial Pyramid Matching sourceOther universitiesVision
17 Jun 2006SVM-CNN sourceNew York University (NYU)Vision1014.9 FLOP
29 May 2006Crazy Stone sourceOther universitiesGames
7 May 2006FAST sourceOther universitiesVideo
2 Feb 2006TFE SVM sourceOther universitiesVision
2005
7 Aug 2005RankNet sourceMicrosoftSearch1012.5 FLOP
25 Jun 2005Histograms of Oriented Gradients sourceOther universitiesVision
6 Jan 2005Hierarchical LM sourceOther groupsLanguage1014.1 FLOP
2004
1 Dec 2004LMICA sourceOther groupsVision1015.4 FLOP
27 Jun 2004Invariant CNN sourceNew York University (NYU)Vision1012.0 FLOP
2003
15 Mar 2003NPLM (Brown) sourceUniversity of Montreal / Université de MontréalLanguage1014.1 FLOP
15 Mar 2003NPLM (AP News) sourceUniversity of Montreal / Université de MontréalLanguage1015.2 FLOP
2 Feb 2003LDA sourceStanford UniversityLanguage
1 Jan 2003Statistical Shape Constellations sourceOther universitiesVision
2002
28 May 2002Thumbs Up? sourceOther universitiesLanguage
2001
8 Dec 2001Decision tree (classification) sourceOther companiesVision1013.8 FLOP
1 Oct 2001Gradient Boosting Machine sourceStanford UniversityMathematics
6 Jul 2001Immediate trihead sourceOther universitiesLanguage
2000
28 Nov 2000PoE MNIST sourceOther universitiesVision1013.7 FLOP
28 Nov 2000Neural LM sourceUniversity of Montreal / Université de MontréalLanguage1015.8 FLOP
1999
2 Jul 1999IBM Model 4Other universitiesLanguage
2 Jun 1999RECONTRA-uncategorized sourceOther groupsLanguage1012.6 FLOP
2 Jun 1999RECONTRA-categorized sourceOther groupsLanguage1012.9 FLOP
2 Jan 1999LSTM with forget gates sourceOther universitiesLanguage
1998
1 Nov 1998LeNet-5AT&TVision1012.4 FLOP
1997
15 Nov 1997LSTM sourceOther universitiesLanguage1013.5 FLOP
1 Nov 1997Bidirectional RNN sourceOther companiesSpeech
1 May 1997Deep Blue sourceIBMGames
31 Jan 1997SOM-CNN sourceOther groupsVision1010.5 FLOP
1996
3 Jul 1996AdaBoost.M2 Digit Recognition sourceAT&TVision
18 Jun 1996System 11 sourceCarnegie Mellon University (CMU)Vision1010.4 FLOP
3 Jun 1996MUSIC perceptron sourceOther groupsVision1011.9 FLOP
1995
27 Nov 1995LISSOM sourceOther universitiesVision1011.3 FLOP
1 Sep 1995Support Vector Machines sourceAT&TVision
1994
2 Dec 1994Predictive Coding NN sourceOther universitiesLanguage1013.3 FLOP
2 Dec 1994NeuroChess sourceOther groupsGames1011.9 FLOP
2 Dec 1994Mixture of linear models sourceOther groupsVision1011.7 FLOP
2 Dec 1994JPMAX sourceOther groupsVision107.9 FLOP
22 Oct 1994GroupLens sourceMassachusetts Institute of Technology (MIT)Recommendation
7 Jan 1994Ceramic-MLP sourceOther universitiesMaterials science109.7 FLOP
1993
29 Nov 1993ANN Eye Tracker sourceOther groupsVision1010.2 FLOP
1 Aug 1993Siamese-TDNN sourceOther companiesVision1013.1 FLOP
15 Jun 1993IBM-5 sourceIBMLanguage
1992
30 Nov 1992Boosting sourceOther companiesVision
16 Oct 1992Cancer drug mechanism prediction sourceOther groupsMedicine107.7 FLOP
1 Oct 1992Golem sourceOther groupsBiology
1 May 1992TD-Gammon sourceIBMGames1013.3 FLOP
1991
2 Dec 1991Weight Decay sourceOther groupsSpeech1010.9 FLOP
1990
1 Nov 1990RAAM sourceOther groupsOther
1 Oct 1990SexNet compression sourceOther groupsVision1010.9 FLOP
1 Oct 1990SexNet classification sourceOther groupsVision
1 Oct 1990ISR network sourceStanford UniversityVision
17 Jun 1990Bankruptcy-NN sourceOther groupsOther109.5 FLOP
1 Jun 1990NETtalk reimplementation sourceOther universitiesSpeech1010.6 FLOP
1989
1 Dec 1989Zip CNN sourceAT&TVision1012.2 FLOP
27 Nov 1989Speaker-independent vowel classification sourceUniversity of WashingtonSpeech109.9 FLOP
27 Nov 1989Handwritten digit recognition network sourceAT&TVision1011.3 FLOP
18 Jun 1989Truck backer-upper sourceStanford UniversityDriving
18 Jun 1989Invariant image recognition sourceOther universitiesVision1010.4 FLOP
1 Jan 1989Q-learningOther universitiesRobotics
1 Jan 1989MLP baggage detector sourceOther companiesVision
1988
1 Aug 1988MLN-ASR sourceOther universitiesSpeech108.5 FLOP
5 Apr 1988Latent semantic analysis sourceOther universitiesLanguage
1987
15 Jun 1987Translation-invariant MLP sourceCarnegie Mellon University (CMU)1010.3 FLOP
6 Jun 1987NetTalk (transcription)Other universitiesSpeech1010.4 FLOP
6 Jun 1987NetTalk (dictionary)Other universitiesSpeech1010.4 FLOP
1986
1 Nov 1986Optimized Multi-Scale Edge Detection sourceMassachusetts Institute of Technology (MIT)Vision
1 Oct 1986MLP with back-propagation sourceOther universitiesMathematics108.8 FLOP
15 Aug 1986Distributed representation NN sourceCarnegie Mellon University (CMU)Other108.6 FLOP
3 Jan 1986Error Propagation sourceOther universitiesOther
1984
1 Apr 1984Hierarchical Cognitron sourceOther companiesOther
1983
1 Sep 1983ASE+ACE sourceOther universitiesRobotics108.5 FLOP
1982
1 Apr 1982Hopfield network sourceOther universitiesOther
1981
25 Jul 1981Kohonen network sourceOther universitiesMathematics
1980
1 Apr 1980Neocognitron sourceOther companiesVision108.4 FLOP
1976
1 Jul 1976Transfer Learning sourceOther universitiesVision
1975
1 Sep 1975Cognitron sourceOther companiesOther106.7 FLOP
1973
1 Nov 1973Piecewise linear model sourceOther universitiesVision
1969
1 May 1969Decision tree adaline sourceOther universitiesMedicine
1968
1 Jul 1968GLEE sourceUniversity of EdinburghGames
1 Jul 1968Boxes (pole) sourceUniversity of EdinburghGames
1966
1 Nov 1966LTE speaker verification system sourceIBMSpeech108.0 FLOP
1965
1 Oct 1965Heuristic Reinforcement Learning sourceOther universitiesRobotics106.0 FLOP
1963
1 Jan 1963Print Recognition Logic sourceIBMVision107.3 FLOP
1962
1 Jul 1962MADALINE I sourceStanford UniversityOther
1 Jun 1962Linear Decision Functions sourceOther companiesMathematics106.2 FLOP
1960
30 Jun 1960ADALINE sourceStanford UniversityVision103.8 FLOP
30 Mar 1960Perceptron (1960) sourceOther universitiesVision108.9 FLOP
1959
1 Dec 1959Pattern recognition and reading by machine sourceOther companiesVision
1 Jul 1959Samuel Neural Checkers sourceIBMGames108.6 FLOP
1 Feb 1959Pandemonium (morse) sourceMassachusetts Institute of Technology (MIT)Language108.8 FLOP
1957
1 Jan 1957Perceptron Mark I sourceOther universitiesOther105.8 FLOP
1955
1 Mar 1955Sequence-based pattern recognition sourceMassachusetts Institute of Technology (MIT)Vision
1 Mar 1955Self Organizing System sourceMassachusetts Institute of Technology (MIT)Other
1954
2 Jul 1954Genetic algorithm sourceOther universitiesMathematics
1952
8 Jan 1952SNARC sourceOther universitiesRobotics
1950
2 Jul 1950Theseus sourceOther companiesRobotics101.6 FLOP