Skip to content
IFAI

Model rankings

114 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published September 4, 2024

Most preferred
chatgpt-4o-latestOpenAI1,289Score
Best open model
Best from China
glm-4-0520Zhipu AI1,187Score
Most voted
llama-3-70b-instructMeta163,952Votes
Top three by Score
1chatgpt-4o-latestOpenAI1,289
2gpt-4o-2024-05-13OpenAI1,262
Top three open models
1llama-3.1-405b-instructMeta · #5 overall1,250
2mistral-large-2407Mistral · #14 overall1,229
3athene-70b-0725NexusFlow · #16 overall1,218
RankChangeModelScore95% intervalVotesPrice $/M
1—chatgpt-4o-latestClosedOpenAI1,289±431,148—
2—gpt-4o-2024-05-13ClosedOpenAI1,262±386,306—
3—claude-3-5-sonnet-20240620ClosedAnthropic1,259±456,674—
4—gemini-advanced-0514ClosedGoogle1,251±352,236—
5▲ 1llama-3.1-405b-instructOpenMeta1,250±427,397—
6▼ 1grok-2-2024-08-13ClosedxAI1,249±516,215—
7—gpt-4o-2024-08-06ClosedOpenAI1,247±418,093—
8—gpt-4-turbo-2024-04-09ClosedOpenAI1,241±390,149—
9—claude-3-opus-20240229ClosedAnthropic1,237±3161,782—
10—gemini-1.5-pro-api-0514ClosedGoogle1,237±476,952—
11—gpt-4-1106-previewClosedOpenAI1,234±395,438—
12—gpt-4o-mini-2024-07-18ClosedOpenAI1,231±426,088—
13—gpt-4-0125-previewClosedOpenAI1,230±388,711—
14—mistral-large-2407OpenMistral · 1 more variant1,229±520,734—
15▲ 1grok-2-mini-2024-08-13ClosedxAI1,219±516,731—
16▼ 1athene-70b-0725OpenNexusFlow1,218±517,254—
17—llama-3.1-70b-instructOpenMeta1,211±422,161—
18—gemma-2-27b-itOpenGoogle1,203±433,751—
19—gpt-4-0314ClosedOpenAI1,201±355,963—
20—gemini-1.5-flash-api-0514ClosedGoogle1,201±362,135—
21▲ 2jamba-1.5-largeOpenAI21 Labs1,198±77,629—
22▼ 1claude-3-sonnet-20240229ClosedAnthropic1,197±3113,053—
23▼ 1nemotron-4-340b-instructOpenNVIDIA1,195±420,653—
24Newgemma-2-9b-it-simpoOpenPrinceton1,194±68,862—
25▼ 1llama-3-70b-instructOpenMeta1,193±3163,952—
26Newcommand-r-plus-08-2024OpenCohere1,192±151,843—
27▼ 2glm-4-0520ClosedZhipu AI1,187±610,232—
28▼ 2gpt-4-0613ClosedOpenAI1,187±391,662—
29▼ 2command-r-plusOpenCohere1,183±380,888—
30▼ 2deepseek-coder-v2OpenDeepSeek1,181±515,794—
31▼ 2qwen2-72b-instructOpenAlibaba1,180±437,463—
32▼ 2claude-3-haiku-20240307ClosedAnthropic1,176±3112,921—
33▼ 2gemma-2-9b-itOpenGoogle1,173±428,281—
34Newcommand-r-08-2024OpenCohere1,164±151,885—
35▼ 2qwen1.5-110b-chatOpenAlibaba1,154±327,457—
36▼ 4jamba-1.5-miniOpenAI21 Labs1,153±67,731—
37▼ 3reka-flash-21b-20240226-onlineClosedReka AI1,151±516,027—
38▼ 3mixtral-8x22b-instruct-v0.1OpenMistral1,149±453,121—
39▼ 3qwen1.5-72b-chatOpenAlibaba1,148±340,628—
40▼ 3command-rOpenCohere1,148±356,363—
41▼ 3gemini-pro-dev-apiClosedGoogle1,147±418,781—
42▼ 3mistral-mediumClosedMistral1,141±335,545—
43▼ 2llama-3-8b-instructOpenMeta1,141±3109,362—
44▼ 4reka-flash-21b-20240226ClosedReka AI1,141±425,795—
45▼ 3gpt-3.5-turbo-0125ClosedOpenAI · 1 more variant1,138±368,869—
46▼ 3gemini-proClosedGoogle1,132±66,560—
47▼ 3yi-1.5-34b-chatOpen01 AI1,132±425,161—
48▼ 3zephyr-orpo-141b-A35b-v0.1OpenHuggingFace1,131±74,858—
49▼ 3qwen1.5-32b-chatOpenAlibaba1,127±422,751—
50▼ 2llama-3.1-8b-instructOpenMeta1,119±420,642—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.