Skip to content
IFAI

Model rankings

124 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published October 7, 2024

Most preferred
o1-previewOpenAI1,300Score
Best open model
Best from China
qwen2.5-72b-instructAlibaba1,218Score
Most voted
claude-3-opus-20240229Anthropic171,390Votes
Top three by Score
1o1-previewOpenAI1,300
2gemini-1.5-pro-002Google1,269
3gpt-4o-2024-05-13OpenAI1,261
Top three open models
1llama-3.1-405b-instruct-bf16Meta · #7 overall1,252
2llama-3.1-405b-instruct-fp8Meta · #8 overall1,251
3mistral-large-2407Mistral · #16 overall1,230
RankChangeModelScore95% intervalVotesPrice $/M
1—llama-3.1-405b-instruct-bf16OpenMeta1,252±711,826—
2—llama-3.1-405b-instruct-fp8OpenMeta1,251±436,694—
3—mistral-large-2407OpenMistral1,230±332,970—
4▲ 1athene-70b-0725OpenNexusFlow1,220±420,689—
5▼ 1qwen2.5-72b-instructOpenAlibaba1,218±611,306—
6—deepseek-v2.5OpenDeepSeek1,217±611,330—
7—llama-3.1-70b-instructOpenMeta1,211±431,908—
8—gemma-2-27b-itOpenGoogle1,203±443,220—
9—jamba-1.5-largeOpenAI21 Labs1,202±79,179—
10—gemma-2-9b-it-simpoOpenPrinceton1,197±510,612—
11—nemotron-4-340b-instructOpenNVIDIA1,195±520,641—
12—llama-3-70b-instructOpenMeta1,194±3163,833—
13—command-r-plus-08-2024OpenCohere1,191±79,115—
14—command-r-plusOpenCohere1,182±380,862—
15▲ 1deepseek-coder-v2OpenDeepSeek1,181±515,791—
16▼ 1qwen2-72b-instructOpenAlibaba1,180±338,973—
17—gemma-2-9b-itOpenGoogle1,175±433,147—
18—command-r-08-2024OpenCohere1,174±79,460—
19—jamba-1.5-miniOpenAI21 Labs1,158±69,294—
20—qwen1.5-110b-chatOpenAlibaba1,155±427,442—
21—mixtral-8x22b-instruct-v0.1OpenMistral1,150±353,817—
22▲ 1command-rOpenCohere1,148±356,369—
23▼ 1qwen1.5-72b-chatOpenAlibaba1,147±440,610—
24—llama-3-8b-instructOpenMeta1,141±3109,318—
25—yi-1.5-34b-chatOpen01 AI1,131±425,141—
26—zephyr-orpo-141b-A35b-v0.1OpenHuggingFace1,131±74,858—
27—qwen1.5-32b-chatOpenAlibaba1,126±422,738—
28—llama-3.1-8b-instructOpenMeta1,124±530,110—
29—phi-3-medium-4k-instructOpenMicrosoft1,118±426,141—
30▲ 16internlm2_5-20b-chatOpenInternLM1,115±95,076—
31▼ 1mixtral-8x7b-instruct-v0.1OpenMistral1,114±076,106—
32▼ 1dbrx-instruct-previewOpenDatabricks1,114±433,704—
33—gemma-2-2b-itOpenGoogle1,109±524,658—
34▼ 2qwen1.5-14b-chatOpenAlibaba1,106±418,656—
35▼ 1wizardlm-70bOpenMicrosoft1,105±78,383—
36▼ 1snowflake-arctic-instructOpenSnowflake1,103±334,158—
37▼ 1openchat-3.5-0106OpenOpenChat · 1 more variant1,101±412,964—
38▼ 1yi-34b-chatOpen01 AI1,101±515,918—
39—gemma-1.1-7b-itOpenGoogle1,098±425,056—
40▼ 2phi-3-small-8k-instructOpenMicrosoft1,098±418,487—
41—tulu-2-dpo-70bOpenAllenAI/UW1,093±86,662—
42—vicuna-33bOpenLMSYS1,091±522,929—
43▲ 1deepseek-llm-67b-chatOpenDeepSeek1,091±84,979—
44▲ 1openhermes-2.5-mistral-7bOpenNousResearch1,091±95,090—
45▼ 2starling-lm-7b-betaOpenNexusflow1,091±516,660—
46▼ 6llama-3.2-3b-instructOpenMeta1,090±98,604—
47—starling-lm-7b-alphaOpenUC Berkeley1,083±710,413—
48—llama-2-70b-chatOpenMeta1,081±439,612—
49—llama2-70b-steerlm-chatOpenNVIDIA1,074±113,635—
50—nous-hermes-2-mixtral-8x7b-dpoOpenNousResearch1,072±113,839—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.