Skip to content
IFAI

Model rankings

147 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published December 15, 2024

Most preferred
o1-previewOpenAI1,302Score
Best open model
Best from China
yi-lightning01 AI1,246Score
Most voted
claude-3-opus-20240229Anthropic196,315Votes
Top three by Score
1o1-previewOpenAI1,302
3gemini-1.5-pro-002Google1,268
Top three open models
1llama-3.1-405b-instruct-fp8Meta · #7 overall1,252
2llama-3.1-405b-instruct-bf16Meta · #8 overall1,252
3llama-3.3-70b-instructMeta · #18 overall1,234
RankChangeModelScore95% intervalVotesPrice $/M
1—o1-previewClosedOpenAI1,302±332,251—
2—claude-3-5-sonnet-20241022ClosedAnthropic · 1 more variant1,284±338,982—
3—gemini-1.5-pro-002ClosedGoogle1,268±436,776—
4—gpt-4o-2024-05-13ClosedOpenAI1,263±2117,989—
5—o1-miniClosedOpenAI1,258±340,568—
6—gemini-advanced-0514ClosedGoogle1,254±352,201—
7—llama-3.1-405b-instruct-fp8OpenMeta1,252±361,518—
8—llama-3.1-405b-instruct-bf16OpenMeta1,252±514,535—
9▲ 1gpt-4o-2024-08-06ClosedOpenAI1,250±348,165—
10▼ 1grok-2-2024-08-13ClosedxAI1,249±359,097—
11—yi-lightningClosed01 AI1,246±329,191—
12—gpt-4-turbo-2024-04-09ClosedOpenAI1,242±3102,237—
13—gemini-1.5-pro-001ClosedGoogle1,241±382,565—
14—claude-3-opus-20240229ClosedAnthropic1,239±2196,315—
15—gpt-4-1106-previewClosedOpenAI1,235±3103,840—
16—glm-4-plusClosedZhipu AI1,234±427,997—
17—gpt-4o-mini-2024-07-18ClosedOpenAI1,234±356,415—
18Newllama-3.3-70b-instructOpenMeta1,234±77,647—
19Newclaude-3-5-haiku-20241022ClosedAnthropic1,233±94,179—
20▼ 2athene-v2-chatOpenNexusFlow1,232±412,597—
21▼ 2mistral-large-2407OpenMistral · 2 more variants1,231±348,378—
22▼ 2gpt-4-0125-previewClosedOpenAI1,231±397,157—
23▼ 2qwen-max-0919OpenAlibaba1,231±417,581—
24▼ 2gemini-1.5-flash-002ClosedGoogle1,229±430,208—
25▼ 2deepseek-v2.5OpenDeepSeek1,225±326,507—
26▼ 2grok-2-mini-2024-08-13ClosedxAI1,224±351,012—
27▼ 1athene-70b-0725OpenNexusFlow1,223±320,643—
28▼ 3qwen2.5-72b-instructOpenAlibaba1,222±435,637—
29▼ 2llama-3.1-nemotron-70b-instructOpenNVIDIA1,216±57,672—
30▼ 2llama-3.1-70b-instructOpenMeta1,214±357,780—
31▼ 2reka-core-20240904ClosedReka AI1,207±67,973—
32▼ 2gemma-2-27b-itOpenGoogle1,207±367,092—
33Newamazon-nova-pro-v1.0ClosedAmazon1,207±76,195—
34▼ 3jamba-1.5-largeOpenAI21 Labs1,204±69,145—
35▼ 3llama-3.1-nemotron-51b-instructOpenNVIDIA1,204±83,928—
36▼ 3gemini-1.5-flash-001ClosedGoogle1,204±365,728—
37▼ 3gpt-4-0314ClosedOpenAI1,200±355,980—
38▼ 3gemma-2-9b-it-simpoOpenPrinceton1,199±610,569—
39▼ 2command-r-plus-08-2024OpenCohere1,197±510,578—
40▼ 4claude-3-sonnet-20240229ClosedAnthropic1,197±2113,091—
41▼ 3nemotron-4-340b-instructOpenNVIDIA1,196±420,648—
42▼ 3llama-3-70b-instructOpenMeta1,195±2163,884—
43▼ 3reka-flash-20240904ClosedReka AI1,192±68,159—
44▼ 3qwen2.5-coder-32b-instructOpenAlibaba1,189±65,744—
45▼ 3glm-4-0520ClosedZhipu AI1,188±510,225—
46▼ 3gpt-4-0613ClosedOpenAI1,185±391,660—
47Newamazon-nova-lite-v1.0ClosedAmazon1,184±76,238—
48▼ 4c4ai-aya-expanse-32bOpenCohere1,183±422,447—
49▼ 4command-r-plusOpenCohere1,183±280,936—
50▼ 4deepseek-coder-v2OpenDeepSeek1,182±515,785—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.