Skip to content
IFAI

Model rankings

130 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published October 28, 2024

Most preferred
o1-previewOpenAI1,302Score
Best open model
Best from China
yi-lightning01 AI1,241Score
Most voted
claude-3-opus-20240229Anthropic177,919Votes
Top three by Score
1o1-previewOpenAI1,302
3gemini-1.5-pro-002Google1,269
Top three open models
1llama-3.1-405b-instruct-fp8Meta · #7 overall1,251
2llama-3.1-405b-instruct-bf16Meta · #8 overall1,251
3mistral-large-2407Mistral · #19 overall1,229
RankChangeModelScore95% intervalVotesPrice $/M
1—o1-previewClosedOpenAI1,302±521,071—
2Newclaude-3-5-sonnet-20241022ClosedAnthropic1,287±77,284—
3▼ 1gemini-1.5-pro-002ClosedGoogle1,269±515,736—
4▼ 1gpt-4o-2024-05-13ClosedOpenAI1,262±3102,960—
5▼ 1claude-3-5-sonnet-20240620ClosedAnthropic1,258±381,086—
6▼ 1o1-miniClosedOpenAI1,256±423,128—
7▼ 1gemini-advanced-0514ClosedGoogle1,253±352,235—
8▼ 1llama-3.1-405b-instruct-fp8OpenMeta1,251±343,099—
9▼ 1llama-3.1-405b-instruct-bf16OpenMeta1,251±514,607—
10▼ 1grok-2-2024-08-13ClosedxAI1,248±440,873—
11▼ 1gpt-4o-2024-08-06ClosedOpenAI1,248±334,765—
12▼ 1yi-lightningClosed01 AI1,241±520,973—
13▼ 1gpt-4-turbo-2024-04-09ClosedOpenAI1,241±399,055—
14▼ 1gemini-1.5-pro-001ClosedGoogle1,239±382,665—
15▼ 1claude-3-opus-20240229ClosedAnthropic1,238±2177,919—
16▼ 1gpt-4-1106-previewClosedOpenAI1,234±3103,422—
17▼ 1glm-4-plusClosedZhipu AI1,234±519,922—
18▼ 1gpt-4o-mini-2024-07-18ClosedOpenAI1,231±342,661—
19▼ 1gpt-4-0125-previewClosedOpenAI1,230±296,746—
20▼ 1mistral-large-2407OpenMistral1,229±339,456—
21▼ 1qwen-max-0919OpenAlibaba1,228±515,384—
22▼ 1gemini-1.5-flash-002ClosedGoogle1,227±512,379—
23▼ 1grok-2-mini-2024-08-13ClosedxAI1,222±434,105—
24—deepseek-v2.5OpenDeepSeek1,221±417,601—
25—athene-70b-0725OpenNexusFlow1,221±420,711—
26▼ 3qwen2.5-72b-instructOpenAlibaba1,220±417,390—
27—llama-3.1-nemotron-70b-instructOpenNVIDIA1,215±96,228—
28Newllama-3.1-nemotron-51b-instructOpenNVIDIA1,212±131,816—
29▼ 3llama-3.1-70b-instructOpenMeta1,211±338,692—
30▼ 2gemma-2-27b-itOpenGoogle1,205±349,844—
31▼ 2jamba-1.5-largeOpenAI21 Labs1,203±69,182—
32▼ 2gemini-1.5-flash-001ClosedGoogle1,202±365,822—
33▼ 2gpt-4-0314ClosedOpenAI1,200±355,981—
34▼ 2gemma-2-9b-it-simpoOpenPrinceton1,197±610,622—
35▼ 2claude-3-sonnet-20240229ClosedAnthropic1,197±2113,087—
36▼ 2command-r-plus-08-2024OpenCohere1,196±610,599—
37▼ 2nemotron-4-340b-instructOpenNVIDIA1,196±520,649—
38▼ 2llama-3-70b-instructOpenMeta1,194±2163,932—
39▼ 2glm-4-0520ClosedZhipu AI1,187±510,229—
40▼ 2gpt-4-0613ClosedOpenAI1,186±291,680—
41▼ 2command-r-plusOpenCohere1,183±380,899—
42▼ 2deepseek-coder-v2OpenDeepSeek1,181±515,804—
43▼ 2qwen2-72b-instructOpenAlibaba1,180±338,990—
44▼ 2claude-3-haiku-20240307ClosedAnthropic1,177±2121,352—
45▼ 1gemini-1.5-flash-8b-001ClosedGoogle1,176±513,402—
46▼ 3gemma-2-9b-itOpenGoogle1,176±336,551—
47▼ 2command-r-08-2024OpenCohere1,175±610,940—
48▼ 2jamba-1.5-miniOpenAI21 Labs1,158±69,299—
49▼ 2mistral-large-2402ClosedMistral1,158±264,946—
50▼ 2qwen1.5-110b-chatOpenAlibaba1,155±427,486—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.