Skip to content
IFAI

Model rankings

121 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published September 27, 2024

Most preferred
o1-previewOpenAI1,309Score
Best open model
Best from China
qwen2.5-72b-instructAlibaba1,219Score
Most voted
claude-3-opus-20240229Anthropic168,202Votes
Top three by Score
1o1-previewOpenAI1,309
2o1-miniOpenAI1,265
3gpt-4o-2024-05-13OpenAI1,262
Top three open models
1llama-3.1-405b-instruct-bf16Meta · #5 overall1,254
2llama-3.1-405b-instruct-fp8Meta · #7 overall1,251
3mistral-large-2407Mistral · #16 overall1,228
RankChangeModelScore95% intervalVotesPrice $/M
1—o1-previewClosedOpenAI1,309±69,169—
2—o1-miniClosedOpenAI1,265±69,136—
3—gpt-4o-2024-05-13ClosedOpenAI1,262±393,428—
4—claude-3-5-sonnet-20240620ClosedAnthropic1,259±367,165—
5▲ 3llama-3.1-405b-instruct-bf16OpenMeta1,254±88,787—
6▼ 1gemini-advanced-0514ClosedGoogle1,252±452,218—
7▼ 1llama-3.1-405b-instruct-fp8OpenMeta1,251±433,654—
8▼ 1grok-2-2024-08-13ClosedxAI1,249±527,731—
9—gpt-4o-2024-08-06ClosedOpenAI1,247±525,215—
10—gpt-4-turbo-2024-04-09ClosedOpenAI1,241±394,353—
11▲ 1gemini-1.5-pro-api-0514ClosedGoogle1,238±383,372—
12▼ 1claude-3-opus-20240229ClosedAnthropic1,238±2168,202—
13—gpt-4-1106-previewClosedOpenAI1,234±298,754—
14—gpt-4-0125-previewClosedOpenAI1,230±391,889—
15—gpt-4o-mini-2024-07-18ClosedOpenAI1,230±433,166—
16—grok-2-mini-2024-08-13ClosedxAI1,220±524,956—
17—llama-3.1-70b-instructOpenMeta1,211±428,776—
18—gemma-2-27b-itOpenGoogle1,204±440,183—
19▲ 1gemini-1.5-flash-api-0514ClosedGoogle1,201±366,178—
20▼ 1gpt-4-0314ClosedOpenAI1,200±355,943—
21—claude-3-sonnet-20240229ClosedAnthropic1,197±3113,008—
22—nemotron-4-340b-instructOpenNVIDIA1,196±520,639—
23—llama-3-70b-instructOpenMeta1,194±2163,885—
24—gpt-4-0613ClosedOpenAI1,186±391,630—
25—claude-3-haiku-20240307ClosedAnthropic1,176±2116,238—
26—gemma-2-9b-itOpenGoogle1,174±431,557—
27—gemini-pro-dev-apiClosedGoogle1,147±518,776—
28—llama-3-8b-instructOpenMeta1,141±2109,319—
29—gpt-3.5-turbo-0125ClosedOpenAI · 1 more variant1,138±368,868—
30—gemini-proClosedGoogle1,131±76,559—
31—llama-3.1-8b-instructOpenMeta1,125±426,825—
32—phi-3-medium-4k-instructOpenMicrosoft1,118±426,149—
33—dbrx-instruct-previewOpenDatabricks1,113±333,701—
34▲ 2gemma-2-2b-itOpenGoogle1,106±523,138—
35▼ 1wizardlm-70bOpenMicrosoft1,106±68,384—
36▼ 1snowflake-arctic-instructOpenSnowflake1,102±334,149—
37—phi-3-small-8k-instructOpenMicrosoft1,098±418,484—
38—gemma-1.1-7b-itOpenGoogle1,097±325,069—
39Newllama-3.2-3b-instructOpenMeta1,097±96,039—
40▼ 1llama-2-70b-chatOpenMeta1,081±339,612—
41▼ 1llama2-70b-steerlm-chatOpenNVIDIA1,072±93,635—
42▼ 1phi-3-mini-4k-instruct-june-2024OpenMicrosoft1,070±612,887—
43▼ 1wizardlm-13bOpenMicrosoft1,065±77,187—
44Newllama-3.2-1b-instructOpenMeta1,058±106,024—
45▼ 2phi-3-mini-4k-instructOpenMicrosoft1,055±521,113—
46▼ 2llama-2-13b-chatOpenMeta1,053±619,726—
47▼ 2phi-3-mini-128k-instructOpenMicrosoft1,049±521,595—
48—gemma-7b-itOpenGoogle1,046±69,174—
49▼ 2codellama-34b-instructOpenMeta1,046±77,505—
50▼ 4palm-2ClosedGoogle1,045±78,743—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.