Skip to content
IFAI

Model rankings

141 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published December 1, 2024

Most preferred
o1-previewOpenAI1,301Score
Best open model
Best from China
yi-lightning01 AI1,245Score
Most voted
claude-3-opus-20240229Anthropic190,685Votes
Top three by Score
1o1-previewOpenAI1,301
3gemini-1.5-pro-002Google1,267
Top three open models
1llama-3.1-405b-instruct-fp8Meta · #7 overall1,253
2llama-3.1-405b-instruct-bf16Meta · #8 overall1,252
3athene-v2-chatNexusFlow · #18 overall1,232
RankChangeModelScore95% intervalVotesPrice $/M
1—o1-previewClosedOpenAI1,301±429,747—
2—claude-3-5-sonnet-20241022ClosedAnthropic · 1 more variant1,284±433,295—
3—gemini-1.5-pro-002ClosedGoogle1,267±431,240—
4—gpt-4o-2024-05-13ClosedOpenAI1,263±3115,598—
5—o1-miniClosedOpenAI1,258±435,691—
6—gemini-advanced-0514ClosedGoogle1,254±352,216—
7—llama-3.1-405b-instruct-fp8OpenMeta1,253±356,051—
8—llama-3.1-405b-instruct-bf16OpenMeta1,252±514,541—
9—gpt-4o-2024-08-06ClosedOpenAI1,249±346,335—
10—grok-2-2024-08-13ClosedxAI1,249±354,702—
11—yi-lightningClosed01 AI1,245±429,201—
12—gpt-4-turbo-2024-04-09ClosedOpenAI1,242±3102,256—
13—gemini-1.5-pro-001ClosedGoogle1,240±382,552—
14—claude-3-opus-20240229ClosedAnthropic1,238±2190,685—
15—gpt-4-1106-previewClosedOpenAI1,234±2103,865—
16—glm-4-plusClosedZhipu AI1,234±428,021—
17—gpt-4o-mini-2024-07-18ClosedOpenAI1,233±453,789—
18▲ 3athene-v2-chatOpenNexusFlow1,232±87,159—
19▼ 1mistral-large-2407OpenMistral · 2 more variants1,231±448,383—
20▼ 1gpt-4-0125-previewClosedOpenAI1,231±397,210—
21▼ 1qwen-max-0919OpenAlibaba1,230±517,592—
22—gemini-1.5-flash-002ClosedGoogle1,228±424,792—
23—deepseek-v2.5OpenDeepSeek1,224±426,527—
24—grok-2-mini-2024-08-13ClosedxAI1,224±445,929—
25▲ 1athene-70b-0725OpenNexusFlow1,222±420,660—
26▼ 1qwen2.5-72b-instructOpenAlibaba1,222±430,128—
27—llama-3.1-nemotron-70b-instructOpenNVIDIA1,215±67,675—
28—llama-3.1-70b-instructOpenMeta1,213±452,009—
29Newreka-core-20240904ClosedReka AI1,207±67,975—
30▼ 1gemma-2-27b-itOpenGoogle1,206±461,424—
31—jamba-1.5-largeOpenAI21 Labs1,204±59,149—
32▼ 2llama-3.1-nemotron-51b-instructOpenNVIDIA1,204±93,924—
33▼ 1gemini-1.5-flash-001ClosedGoogle1,204±365,763—
34▼ 1gpt-4-0314ClosedOpenAI1,200±355,980—
35▼ 1gemma-2-9b-it-simpoOpenPrinceton1,199±610,564—
36▼ 1claude-3-sonnet-20240229ClosedAnthropic1,197±2113,103—
37▼ 1command-r-plus-08-2024OpenCohere1,197±610,569—
38▼ 1nemotron-4-340b-instructOpenNVIDIA1,196±420,646—
39▼ 1llama-3-70b-instructOpenMeta1,195±3163,906—
40Newreka-flash-20240904ClosedReka AI1,192±68,167—
41▼ 2qwen2.5-coder-32b-instructOpenAlibaba1,189±75,755—
42▼ 2glm-4-0520ClosedZhipu AI1,188±510,229—
43▼ 2gpt-4-0613ClosedOpenAI1,186±391,679—
44▼ 2command-r-plusOpenCohere1,183±280,919—
45▼ 2c4ai-aya-expanse-32bOpenCohere1,182±517,583—
46▼ 2deepseek-coder-v2OpenDeepSeek1,182±415,788—
47▼ 2qwen2-72b-instructOpenAlibaba1,181±338,960—
48▼ 2gemma-2-9b-itOpenGoogle1,178±343,070—
49▼ 1gemini-1.5-flash-8b-001ClosedGoogle1,177±426,266—
50▼ 3claude-3-haiku-20240307ClosedAnthropic1,177±2122,419—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.