Skip to content
IFAI

Model rankings

132 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published November 13, 2024

Most preferred
o1-previewOpenAI1,300Score
Best open model
Best from China
yi-lightning01 AI1,244Score
Most voted
claude-3-opus-20240229Anthropic183,545Votes
Top three by Score
1o1-previewOpenAI1,300
3gemini-1.5-pro-002Google1,266
Top three open models
1llama-3.1-405b-instruct-fp8Meta · #7 overall1,252
2llama-3.1-405b-instruct-bf16Meta · #8 overall1,251
3mistral-large-2407Mistral · #18 overall1,230
RankChangeModelScore95% intervalVotesPrice $/M
1—o1-previewClosedOpenAI1,300±426,268—
2—claude-3-5-sonnet-20241022ClosedAnthropic · 1 more variant1,284±526,047—
3—gemini-1.5-pro-002ClosedGoogle1,266±423,856—
4—gpt-4o-2024-05-13ClosedOpenAI1,262±3108,575—
5—o1-miniClosedOpenAI1,257±528,953—
6—gemini-advanced-0514ClosedGoogle1,253±452,219—
7—llama-3.1-405b-instruct-fp8OpenMeta1,252±448,804—
8—llama-3.1-405b-instruct-bf16OpenMeta1,251±514,611—
9—grok-2-2024-08-13ClosedxAI1,249±347,908—
10—gpt-4o-2024-08-06ClosedOpenAI1,248±440,499—
11—yi-lightningClosed01 AI1,244±427,114—
12—gpt-4-turbo-2024-04-09ClosedOpenAI1,241±3101,865—
13—gemini-1.5-pro-001ClosedGoogle1,239±382,621—
14—claude-3-opus-20240229ClosedAnthropic1,238±2183,545—
15—gpt-4-1106-previewClosedOpenAI1,234±3103,870—
16—glm-4-plusClosedZhipu AI1,233±525,601—
17—gpt-4o-mini-2024-07-18ClosedOpenAI1,231±448,407—
18▲ 1mistral-large-2407OpenMistral · 1 more variant1,230±345,046—
19▼ 1gpt-4-0125-previewClosedOpenAI1,230±397,202—
20—qwen-max-0919OpenAlibaba1,229±417,642—
21—gemini-1.5-flash-002ClosedGoogle1,228±518,112—
22—deepseek-v2.5OpenDeepSeek1,223±422,918—
23—grok-2-mini-2024-08-13ClosedxAI1,223±439,214—
24—qwen2.5-72b-instructOpenAlibaba1,222±423,112—
25—athene-70b-0725OpenNexusFlow1,221±520,697—
26—llama-3.1-nemotron-70b-instructOpenNVIDIA1,214±77,263—
27—llama-3.1-70b-instructOpenMeta1,212±444,687—
28▲ 1gemma-2-27b-itOpenGoogle1,205±454,961—
29▲ 3llama-3.1-nemotron-51b-instructOpenNVIDIA1,204±73,943—
30—jamba-1.5-largeOpenAI21 Labs1,203±69,186—
31—gemini-1.5-flash-001ClosedGoogle1,203±365,794—
32▲ 1gpt-4-0314ClosedOpenAI1,200±355,966—
33▲ 1gemma-2-9b-it-simpoOpenPrinceton1,198±610,613—
34▲ 1claude-3-sonnet-20240229ClosedAnthropic1,197±2113,045—
35▲ 1command-r-plus-08-2024OpenCohere1,197±510,608—
36▲ 1nemotron-4-340b-instructOpenNVIDIA1,196±420,641—
37▲ 1llama-3-70b-instructOpenMeta1,194±2163,858—
38▲ 2glm-4-0520ClosedZhipu AI1,187±610,228—
39▲ 2gpt-4-0613ClosedOpenAI1,186±391,646—
40▲ 2command-r-plusOpenCohere1,183±380,879—
41▲ 2deepseek-coder-v2OpenDeepSeek1,181±515,796—
42▲ 2qwen2-72b-instructOpenAlibaba1,180±438,980—
43▲ 4gemma-2-9b-itOpenGoogle1,177±339,510—
44▲ 1claude-3-haiku-20240307ClosedAnthropic1,177±3122,422—
45▲ 1gemini-1.5-flash-8b-001ClosedGoogle1,177±519,267—
46▲ 2command-r-08-2024OpenCohere1,176±510,924—
47▲ 2jamba-1.5-miniOpenAI21 Labs1,159±79,296—
48Newministral-8b-2410OpenMistral1,156±122,333—
49▲ 1qwen1.5-110b-chatOpenAlibaba1,155±427,472—
50▲ 1reka-flash-21b-20240226-onlineClosedReka AI1,151±516,023—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.