Skip to content
IFAI

Model rankings

117 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published September 17, 2024

Most preferred
o1-previewOpenAI1,326Score
Best open model
Best from China
deepseek-v2.5DeepSeek1,211Score
Most voted
claude-3-opus-20240229Anthropic165,503Votes
Top three by Score
1o1-previewOpenAI1,326
2o1-miniOpenAI1,275
3gpt-4o-2024-05-13OpenAI1,261
Top three open models
1llama-3.1-405b-instruct-fp8Meta · #6 overall1,250
2llama-3.1-405b-instruct-bf16Meta · #8 overall1,249
3mistral-large-2407Mistral · #16 overall1,228
RankChangeModelScore95% intervalVotesPrice $/M
1Newo1-previewClosedOpenAI1,326±122,991—
2Newo1-miniClosedOpenAI1,275±123,009—
3▼ 2gpt-4o-2024-05-13ClosedOpenAI1,261±390,695—
4▼ 2claude-3-5-sonnet-20240620ClosedAnthropic1,258±362,977—
5▼ 2gemini-advanced-0514ClosedGoogle1,251±352,218—
6▼ 1llama-3.1-405b-instruct-fp8OpenMeta1,250±431,280—
7▼ 1grok-2-2024-08-13ClosedxAI1,249±523,999—
8▼ 4llama-3.1-405b-instruct-bf16OpenMeta1,249±75,865—
9▼ 2gpt-4o-2024-08-06ClosedOpenAI1,247±422,562—
10▼ 2gpt-4-turbo-2024-04-09ClosedOpenAI1,241±392,973—
11▼ 2claude-3-opus-20240229ClosedAnthropic1,237±3165,503—
12▼ 2gemini-1.5-pro-api-0514ClosedGoogle1,237±380,656—
13▼ 2gpt-4-1106-previewClosedOpenAI1,235±397,378—
14▼ 1gpt-4-0125-previewClosedOpenAI1,230±390,560—
15▼ 3gpt-4o-mini-2024-07-18ClosedOpenAI1,229±430,434—
16▼ 2mistral-large-2407OpenMistral · 1 more variant1,228±427,285—
17▼ 2grok-2-mini-2024-08-13ClosedxAI1,218±422,041—
18▼ 2athene-70b-0725OpenNexusFlow1,218±420,738—
19▼ 2deepseek-v2.5OpenDeepSeek1,211±85,595—
20▼ 2llama-3.1-70b-instructOpenMeta1,209±426,253—
21▼ 2gemma-2-27b-itOpenGoogle1,203±337,529—
22▼ 2jamba-1.5-largeOpenAI21 Labs1,201±69,191—
23▼ 1gpt-4-0314ClosedOpenAI1,201±355,947—
24▼ 3gemini-1.5-flash-api-0514ClosedGoogle1,200±364,810—
25▼ 2gemma-2-9b-it-simpoOpenPrinceton1,197±510,617—
26▼ 2claude-3-sonnet-20240229ClosedAnthropic1,197±3113,039—
27▼ 2nemotron-4-340b-instructOpenNVIDIA1,196±420,650—
28▼ 2llama-3-70b-instructOpenMeta1,194±3163,849—
29▼ 2command-r-plus-08-2024OpenCohere1,190±75,653—
30▼ 2glm-4-0520ClosedZhipu AI1,187±610,230—
31▼ 2gpt-4-0613ClosedOpenAI1,187±391,629—
32▼ 2command-r-plusOpenCohere1,182±380,852—
33▼ 2qwen2-72b-instructOpenAlibaba1,181±338,976—
34▼ 2deepseek-coder-v2OpenDeepSeek1,179±515,792—
35▼ 2claude-3-haiku-20240307ClosedAnthropic1,176±3114,780—
36▼ 2gemma-2-9b-itOpenGoogle1,173±430,237—
37▼ 2command-r-08-2024OpenCohere1,165±85,837—
38▼ 1qwen1.5-110b-chatOpenAlibaba1,155±427,451—
39▼ 3jamba-1.5-miniOpenAI21 Labs1,154±69,305—
40▼ 2reka-flash-21b-20240226-onlineClosedReka AI1,151±416,034—
41▼ 2mixtral-8x22b-instruct-v0.1OpenMistral1,149±353,817—
42▼ 2qwen1.5-72b-chatOpenAlibaba1,148±340,604—
43▼ 2command-rOpenCohere1,148±356,368—
44▼ 2gemini-pro-dev-apiClosedGoogle1,147±518,773—
45▼ 1reka-flash-21b-20240226ClosedReka AI1,142±425,795—
46▼ 3mistral-mediumClosedMistral1,142±335,543—
47▼ 2llama-3-8b-instructOpenMeta1,141±3109,335—
48▼ 2gpt-3.5-turbo-0125ClosedOpenAI · 1 more variant1,138±368,863—
49▼ 1gemini-proClosedGoogle1,133±96,556—
50▼ 3yi-1.5-34b-chatOpen01 AI1,132±425,134—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.