Skip to content
IFAI

Model rankings

124 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published October 7, 2024

Most preferred
o1-previewOpenAI1,300Score
Best open model
Best from China
qwen2.5-72b-instructAlibaba1,218Score
Most voted
claude-3-opus-20240229Anthropic171,390Votes
Top three by Score
1o1-previewOpenAI1,300
2gemini-1.5-pro-002Google1,269
3gpt-4o-2024-05-13OpenAI1,261
Top three open models
1llama-3.1-405b-instruct-bf16Meta · #7 overall1,252
2llama-3.1-405b-instruct-fp8Meta · #8 overall1,251
3mistral-large-2407Mistral · #16 overall1,230
RankChangeModelScore95% intervalVotesPrice $/M
1—o1-previewClosedOpenAI1,300±713,725—
2Newgemini-1.5-pro-002ClosedGoogle1,269±68,872—
3—gpt-4o-2024-05-13ClosedOpenAI1,261±396,501—
4▼ 2o1-miniClosedOpenAI1,261±613,988—
5▼ 1claude-3-5-sonnet-20240620ClosedAnthropic1,257±371,813—
6—gemini-advanced-0514ClosedGoogle1,252±352,211—
7▼ 2llama-3.1-405b-instruct-bf16OpenMeta1,252±711,826—
8▼ 1llama-3.1-405b-instruct-fp8OpenMeta1,251±436,694—
9▼ 1grok-2-2024-08-13ClosedxAI1,250±431,887—
10▼ 1gpt-4o-2024-08-06ClosedOpenAI1,248±428,238—
11▼ 1gpt-4-turbo-2024-04-09ClosedOpenAI1,241±395,862—
12▼ 1gemini-1.5-pro-api-0514ClosedGoogle1,238±486,453—
13▼ 1claude-3-opus-20240229ClosedAnthropic1,238±2171,390—
14▼ 1gpt-4-1106-previewClosedOpenAI1,234±3100,189—
15—gpt-4o-mini-2024-07-18ClosedOpenAI1,231±436,122—
16▼ 2gpt-4-0125-previewClosedOpenAI1,230±393,372—
17▼ 1grok-2-mini-2024-08-13ClosedxAI1,221±427,913—
18Newgemini-1.5-flash-002ClosedGoogle1,220±76,339—
19▼ 2llama-3.1-70b-instructOpenMeta1,211±431,908—
20▼ 2gemma-2-27b-itOpenGoogle1,203±443,220—
21▼ 2gemini-1.5-flash-api-0514ClosedGoogle1,202±367,665—
22▼ 2gpt-4-0314ClosedOpenAI1,200±355,933—
23▼ 2claude-3-sonnet-20240229ClosedAnthropic1,197±3113,010—
24▼ 2nemotron-4-340b-instructOpenNVIDIA1,195±520,641—
25▼ 2llama-3-70b-instructOpenMeta1,194±3163,833—
26▼ 2gpt-4-0613ClosedOpenAI1,186±391,615—
27▼ 2claude-3-haiku-20240307ClosedAnthropic1,176±2117,916—
28▼ 2gemma-2-9b-itOpenGoogle1,175±433,147—
29Newgemini-1.5-flash-8b-001ClosedGoogle1,175±77,047—
30▼ 3gemini-pro-dev-apiClosedGoogle1,147±518,771—
31▼ 3llama-3-8b-instructOpenMeta1,141±3109,318—
32▼ 3gpt-3.5-turbo-0125ClosedOpenAI · 1 more variant1,138±368,849—
33▼ 3gemini-proClosedGoogle1,132±86,556—
34▼ 3llama-3.1-8b-instructOpenMeta1,124±530,110—
35▼ 3phi-3-medium-4k-instructOpenMicrosoft1,118±426,141—
36▼ 3dbrx-instruct-previewOpenDatabricks1,114±433,704—
37▼ 3gemma-2-2b-itOpenGoogle1,109±524,658—
38▼ 3wizardlm-70bOpenMicrosoft1,105±78,383—
39▼ 3snowflake-arctic-instructOpenSnowflake1,103±334,158—
40▼ 2gemma-1.1-7b-itOpenGoogle1,098±425,056—
41▼ 4phi-3-small-8k-instructOpenMicrosoft1,098±418,487—
42▼ 3llama-3.2-3b-instructOpenMeta1,090±98,604—
43▼ 3llama-2-70b-chatOpenMeta1,081±439,612—
44▼ 3llama2-70b-steerlm-chatOpenNVIDIA1,074±113,635—
45▼ 3phi-3-mini-4k-instruct-june-2024OpenMicrosoft1,069±612,877—
46▼ 3wizardlm-13bOpenMicrosoft1,064±87,183—
47▼ 2phi-3-mini-4k-instructOpenMicrosoft1,055±421,116—
48▼ 2llama-2-13b-chatOpenMeta1,053±419,736—
49▼ 2phi-3-mini-128k-instructOpenMicrosoft1,049±521,589—
50▼ 2gemma-7b-itOpenGoogle1,047±69,176—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.