Skip to content
IFAI

Model rankings

132 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published November 4, 2024

Most preferred
o1-previewOpenAI1,300Score
Best open model
Best from China
yi-lightning01 AI1,243Score
Most voted
claude-3-opus-20240229Anthropic180,601Votes
Top three by Score
1o1-previewOpenAI1,300
3gemini-1.5-pro-002Google1,266
Top three open models
1llama-3.1-405b-instruct-fp8Meta · #7 overall1,252
2llama-3.1-405b-instruct-bf16Meta · #8 overall1,251
3mistral-large-2407Mistral · #19 overall1,230
RankChangeModelScore95% intervalVotesPrice $/M
1—o1-previewClosedOpenAI1,300±423,562—
2—claude-3-5-sonnet-20241022ClosedAnthropic1,284±519,005—
3—gemini-1.5-pro-002ClosedGoogle1,266±419,523—
4—gpt-4o-2024-05-13ClosedOpenAI1,262±3105,541—
5—claude-3-5-sonnet-20240620ClosedAnthropic1,258±383,825—
6—o1-miniClosedOpenAI1,256±526,062—
7—gemini-advanced-0514ClosedGoogle1,253±452,230—
8—llama-3.1-405b-instruct-fp8OpenMeta1,252±345,768—
9—llama-3.1-405b-instruct-bf16OpenMeta1,251±514,608—
10—grok-2-2024-08-13ClosedxAI1,248±343,774—
11—gpt-4o-2024-08-06ClosedOpenAI1,248±437,444—
12—yi-lightningClosed01 AI1,243±424,473—
13—gpt-4-turbo-2024-04-09ClosedOpenAI1,241±2100,404—
14—gemini-1.5-pro-001ClosedGoogle1,239±382,660—
15—claude-3-opus-20240229ClosedAnthropic1,238±2180,601—
16—gpt-4-1106-previewClosedOpenAI1,234±2103,894—
17—glm-4-plusClosedZhipu AI1,234±422,574—
18—gpt-4o-mini-2024-07-18ClosedOpenAI1,231±445,274—
19—gpt-4-0125-previewClosedOpenAI1,230±397,214—
20—mistral-large-2407OpenMistral1,230±342,110—
21—qwen-max-0919OpenAlibaba1,229±417,658—
22—gemini-1.5-flash-002ClosedGoogle1,228±515,030—
23▲ 1deepseek-v2.5OpenDeepSeek1,223±420,034—
24▼ 1grok-2-mini-2024-08-13ClosedxAI1,222±436,342—
25▲ 1qwen2.5-72b-instructOpenAlibaba1,221±420,113—
26▼ 1athene-70b-0725OpenNexusFlow1,221±520,709—
27—llama-3.1-nemotron-70b-instructOpenNVIDIA1,215±66,572—
28▲ 1llama-3.1-70b-instructOpenMeta1,211±341,484—
29Newreka-core-20240904ClosedReka AI1,206±68,013—
30—gemma-2-27b-itOpenGoogle1,205±352,532—
31—jamba-1.5-largeOpenAI21 Labs1,203±69,188—
32—gemini-1.5-flash-001ClosedGoogle1,202±365,808—
33▼ 5llama-3.1-nemotron-51b-instructOpenNVIDIA1,201±93,153—
34▼ 1gpt-4-0314ClosedOpenAI1,200±355,978—
35▼ 1gemma-2-9b-it-simpoOpenPrinceton1,198±610,618—
36▼ 1claude-3-sonnet-20240229ClosedAnthropic1,197±3113,076—
37▼ 1command-r-plus-08-2024OpenCohere1,196±510,602—
38▼ 1nemotron-4-340b-instructOpenNVIDIA1,196±420,645—
39▼ 1llama-3-70b-instructOpenMeta1,194±3163,936—
40Newreka-flash-20240904ClosedReka AI1,192±58,204—
41▼ 2glm-4-0520ClosedZhipu AI1,187±610,229—
42▼ 2gpt-4-0613ClosedOpenAI1,186±391,664—
43▼ 2command-r-plusOpenCohere1,183±380,907—
44▼ 2deepseek-coder-v2OpenDeepSeek1,181±415,798—
45▼ 2qwen2-72b-instructOpenAlibaba1,180±338,985—
46▼ 2claude-3-haiku-20240307ClosedAnthropic1,177±2122,440—
47▼ 2gemini-1.5-flash-8b-001ClosedGoogle1,177±516,178—
48▼ 2gemma-2-9b-itOpenGoogle1,176±337,949—
49▼ 2command-r-08-2024OpenCohere1,175±510,931—
50▼ 2jamba-1.5-miniOpenAI21 Labs1,158±69,298—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.