Skip to content
IFAI

Model rankings

117 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published September 17, 2024

Most preferred
o1-previewOpenAI1,326Score
Best open model
Best from China
deepseek-v2.5DeepSeek1,211Score
Most voted
claude-3-opus-20240229Anthropic165,503Votes
Top three by Score
1o1-previewOpenAI1,326
2o1-miniOpenAI1,275
3gpt-4o-2024-05-13OpenAI1,261
Top three open models
1llama-3.1-405b-instruct-fp8Meta · #6 overall1,250
2llama-3.1-405b-instruct-bf16Meta · #8 overall1,249
3mistral-large-2407Mistral · #16 overall1,228
RankChangeModelScore95% intervalVotesPrice $/M
1▲ 1llama-3.1-405b-instruct-fp8OpenMeta1,250±431,280—
2▼ 1llama-3.1-405b-instruct-bf16OpenMeta1,249±75,865—
3—mistral-large-2407OpenMistral1,228±427,285—
4—athene-70b-0725OpenNexusFlow1,218±420,738—
5—deepseek-v2.5OpenDeepSeek1,211±85,595—
6—llama-3.1-70b-instructOpenMeta1,209±426,253—
7—gemma-2-27b-itOpenGoogle1,203±337,529—
8—jamba-1.5-largeOpenAI21 Labs1,201±69,191—
9—gemma-2-9b-it-simpoOpenPrinceton1,197±510,617—
10—nemotron-4-340b-instructOpenNVIDIA1,196±420,650—
11—llama-3-70b-instructOpenMeta1,194±3163,849—
12—command-r-plus-08-2024OpenCohere1,190±75,653—
13—command-r-plusOpenCohere1,182±380,852—
14—qwen2-72b-instructOpenAlibaba1,181±338,976—
15—deepseek-coder-v2OpenDeepSeek1,179±515,792—
16—gemma-2-9b-itOpenGoogle1,173±430,237—
17—command-r-08-2024OpenCohere1,165±85,837—
18▲ 1qwen1.5-110b-chatOpenAlibaba1,155±427,451—
19▼ 1jamba-1.5-miniOpenAI21 Labs1,154±69,305—
20—mixtral-8x22b-instruct-v0.1OpenMistral1,149±353,817—
21—qwen1.5-72b-chatOpenAlibaba1,148±340,604—
22—command-rOpenCohere1,148±356,368—
23—llama-3-8b-instructOpenMeta1,141±3109,335—
24—yi-1.5-34b-chatOpen01 AI1,132±425,134—
25—zephyr-orpo-141b-A35b-v0.1OpenHuggingFace1,131±74,856—
26—qwen1.5-32b-chatOpenAlibaba1,127±422,737—
27—llama-3.1-8b-instructOpenMeta1,120±424,107—
28—phi-3-medium-4k-instructOpenMicrosoft1,117±426,139—
29—mixtral-8x7b-instruct-v0.1OpenMistral1,114±076,104—
30—dbrx-instruct-previewOpenDatabricks1,114±333,713—
31▲ 1wizardlm-70bOpenMicrosoft1,108±68,386—
32▼ 1qwen1.5-14b-chatOpenAlibaba1,107±418,657—
33▲ 1snowflake-arctic-instructOpenSnowflake1,103±434,167—
34▼ 1gemma-2-2b-itOpenGoogle1,102±620,713—
35—openchat-3.5-0106OpenOpenChat · 1 more variant1,101±412,978—
36—yi-34b-chatOpen01 AI1,101±415,926—
37—phi-3-small-8k-instructOpenMicrosoft1,098±518,489—
38—gemma-1.1-7b-itOpenGoogle1,097±425,064—
39—tulu-2-dpo-70bOpenAllenAI/UW1,093±76,660—
40—vicuna-33bOpenLMSYS1,092±522,926—
41—deepseek-llm-67b-chatOpenDeepSeek1,091±84,979—
42—starling-lm-7b-betaOpenNexusflow1,091±416,661—
43—openhermes-2.5-mistral-7bOpenNousResearch1,091±85,089—
44—starling-lm-7b-alphaOpenUC Berkeley1,084±610,413—
45—llama-2-70b-chatOpenMeta1,082±339,621—
46—llama2-70b-steerlm-chatOpenNVIDIA1,073±103,635—
47—nous-hermes-2-mixtral-8x7b-dpoOpenNousResearch1,072±103,840—
48—phi-3-mini-4k-instruct-june-2024OpenMicrosoft1,069±612,889—
49▲ 3wizardlm-13bOpenMicrosoft1,067±77,187—
50▼ 1mistral-7b-instruct-v0.2OpenMistral1,067±520,046—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.