Skip to content
IFAI

Model rankings

115 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published September 15, 2024

Most preferred
gpt-4o-2024-05-13OpenAI1,262Score
Best open model
Best from China
deepseek-v2.5DeepSeek1,219Score
Most voted
claude-3-opus-20240229Anthropic164,812Votes
Top three by Score
1gpt-4o-2024-05-13OpenAI1,262
Top three open models
1llama-3.1-405b-instruct-bf16Meta · #4 overall1,251
2llama-3.1-405b-instruct-fp8Meta · #5 overall1,250
3mistral-large-2407Mistral · #14 overall1,229
RankChangeModelScore95% intervalVotesPrice $/M
1Newllama-3.1-405b-instruct-bf16OpenMeta1,251±75,516—
2Newllama-3.1-405b-instruct-fp8OpenMeta1,250±430,608—
3▼ 1mistral-large-2407OpenMistral1,229±426,170—
4▼ 1athene-70b-0725OpenNexusFlow1,220±420,300—
5Newdeepseek-v2.5OpenDeepSeek1,219±84,227—
6▼ 2llama-3.1-70b-instructOpenMeta1,210±525,551—
7▼ 2gemma-2-27b-itOpenGoogle1,203±436,824—
8▼ 2jamba-1.5-largeOpenAI21 Labs1,201±69,185—
9▼ 1gemma-2-9b-it-simpoOpenPrinceton1,197±510,624—
10▼ 3nemotron-4-340b-instructOpenNVIDIA1,196±420,647—
11▼ 2llama-3-70b-instructOpenMeta1,193±2163,861—
12▼ 2command-r-plus-08-2024OpenCohere1,192±94,975—
13▼ 2command-r-plusOpenCohere1,182±380,861—
14▼ 1qwen2-72b-instructOpenAlibaba1,181±338,961—
15▼ 3deepseek-coder-v2OpenDeepSeek1,180±415,796—
16▼ 2gemma-2-9b-itOpenGoogle1,173±429,883—
17▼ 2command-r-08-2024OpenCohere1,169±85,133—
18▼ 1jamba-1.5-miniOpenAI21 Labs1,156±69,311—
19▼ 3qwen1.5-110b-chatOpenAlibaba1,155±327,459—
20▼ 2mixtral-8x22b-instruct-v0.1OpenMistral1,149±253,813—
21▼ 2qwen1.5-72b-chatOpenAlibaba1,148±440,614—
22▼ 2command-rOpenCohere1,147±356,361—
23▼ 2llama-3-8b-instructOpenMeta1,141±2111,021—
24▼ 2yi-1.5-34b-chatOpen01 AI1,132±325,148—
25▼ 2zephyr-orpo-141b-A35b-v0.1OpenHuggingFace1,131±84,852—
26▼ 2qwen1.5-32b-chatOpenAlibaba1,127±422,728—
27▼ 2llama-3.1-8b-instructOpenMeta1,122±523,349—
28▼ 2phi-3-medium-4k-instructOpenMicrosoft1,118±426,149—
29▼ 2mixtral-8x7b-instruct-v0.1OpenMistral1,114±076,096—
30▼ 2dbrx-instruct-previewOpenDatabricks1,113±433,721—
31▼ 2qwen1.5-14b-chatOpenAlibaba1,107±418,659—
32▼ 2wizardlm-70bOpenMicrosoft1,106±68,387—
33▼ 1gemma-2-2b-itOpenGoogle1,104±519,964—
34▼ 3snowflake-arctic-instructOpenSnowflake1,102±434,173—
35▼ 2openchat-3.5-0106OpenOpenChat · 1 more variant1,101±512,971—
36▼ 2yi-34b-chatOpen01 AI1,100±515,926—
37▼ 1phi-3-small-8k-instructOpenMicrosoft1,098±418,492—
38▼ 3gemma-1.1-7b-itOpenGoogle1,097±425,060—
39▼ 2tulu-2-dpo-70bOpenAllenAI/UW1,093±66,657—
40▼ 2vicuna-33bOpenLMSYS1,092±422,931—
41▼ 2deepseek-llm-67b-chatOpenDeepSeek1,091±64,979—
42▼ 2starling-lm-7b-betaOpenNexusflow1,091±416,658—
43▼ 2openhermes-2.5-mistral-7bOpenNousResearch1,090±95,091—
44▼ 2starling-lm-7b-alphaOpenUC Berkeley1,083±610,412—
45▼ 2llama-2-70b-chatOpenMeta1,082±339,617—
46▼ 2llama2-70b-steerlm-chatOpenNVIDIA1,072±103,634—
47▼ 2nous-hermes-2-mixtral-8x7b-dpoOpenNousResearch1,071±93,838—
48▼ 2phi-3-mini-4k-instruct-june-2024OpenMicrosoft1,069±612,885—
49▼ 2mistral-7b-instruct-v0.2OpenMistral1,067±420,048—
50▼ 2qwen1.5-7b-chatOpenAlibaba1,067±74,856—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.