Skip to content
IFAI

Model rankings

127 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published October 15, 2024

Most preferred
o1-previewOpenAI1,300Score
Best open model
Best from China
yi-lightning01 AI1,243Score
Most voted
claude-3-opus-20240229Anthropic174,238Votes
Top three by Score
1o1-previewOpenAI1,300
2gemini-1.5-pro-002Google1,271
3gpt-4o-2024-05-13OpenAI1,262
Top three open models
1llama-3.1-405b-instruct-fp8Meta · #7 overall1,252
2llama-3.1-405b-instruct-bf16Meta · #8 overall1,251
3mistral-large-2407Mistral · #19 overall1,230
RankChangeModelScore95% intervalVotesPrice $/M
1—o1-previewClosedOpenAI1,300±517,562—
2—gemini-1.5-pro-002ClosedGoogle1,271±611,430—
3—gpt-4o-2024-05-13ClosedOpenAI1,262±299,251—
4—o1-miniClosedOpenAI1,260±517,919—
5—claude-3-5-sonnet-20240620ClosedAnthropic1,259±375,957—
6—gemini-advanced-0514ClosedGoogle1,252±352,235—
7▲ 1llama-3.1-405b-instruct-fp8OpenMeta1,252±339,428—
8▼ 1llama-3.1-405b-instruct-bf16OpenMeta1,251±514,496—
9—grok-2-2024-08-13ClosedxAI1,249±435,661—
10—gpt-4o-2024-08-06ClosedOpenAI1,247±430,976—
11Newyi-lightningClosed01 AI1,243±513,262—
12▼ 1gpt-4-turbo-2024-04-09ClosedOpenAI1,241±297,256—
13▼ 1gemini-1.5-pro-api-0514ClosedGoogle1,239±289,220—
14▼ 1claude-3-opus-20240229ClosedAnthropic1,238±2174,238—
15▼ 1gpt-4-1106-previewClosedOpenAI1,234±2101,579—
16Newglm-4-plusClosedZhipu AI1,232±513,674—
17▼ 2gpt-4o-mini-2024-07-18ClosedOpenAI1,232±338,831—
18▼ 1gpt-4-0125-previewClosedOpenAI1,230±294,862—
19▼ 3mistral-large-2407OpenMistral1,230±435,788—
20Newqwen-max-0919OpenAlibaba1,228±512,205—
21▼ 1gemini-1.5-flash-002ClosedGoogle1,225±68,957—
22—deepseek-v2.5OpenDeepSeek1,222±513,969—
23▼ 5grok-2-mini-2024-08-13ClosedxAI1,221±430,597—
24▼ 3qwen2.5-72b-instructOpenAlibaba1,221±513,896—
25▼ 6athene-70b-0725OpenNexusFlow1,220±420,703—
26▼ 3llama-3.1-70b-instructOpenMeta1,210±334,744—
27▼ 3gemma-2-27b-itOpenGoogle1,205±346,053—
28▼ 3jamba-1.5-largeOpenAI21 Labs1,202±69,189—
29▼ 3gemini-1.5-flash-api-0514ClosedGoogle1,202±369,151—
30▼ 3gpt-4-0314ClosedOpenAI1,200±455,979—
31▼ 3gemma-2-9b-it-simpoOpenPrinceton1,198±510,621—
32▼ 3claude-3-sonnet-20240229ClosedAnthropic1,197±2113,073—
33▼ 3nemotron-4-340b-instructOpenNVIDIA1,196±420,656—
34▼ 2command-r-plus-08-2024OpenCohere1,196±510,523—
35▼ 4llama-3-70b-instructOpenMeta1,194±2163,997—
36▼ 3glm-4-0520ClosedZhipu AI1,188±610,229—
37▼ 3gpt-4-0613ClosedOpenAI1,186±291,686—
38▼ 3command-r-plusOpenCohere1,183±280,926—
39▼ 2qwen2-72b-instructOpenAlibaba1,181±338,986—
40▼ 4deepseek-coder-v2OpenDeepSeek1,180±415,799—
41▼ 3claude-3-haiku-20240307ClosedAnthropic1,177±2119,440—
42▼ 2gemini-1.5-flash-8b-001ClosedGoogle1,177±510,389—
43▼ 4gemma-2-9b-itOpenGoogle1,175±334,626—
44▼ 3command-r-08-2024OpenCohere1,175±610,907—
45▼ 2mistral-large-2402ClosedMistral1,158±364,952—
46▼ 4jamba-1.5-miniOpenAI21 Labs1,156±69,300—
47▼ 3qwen1.5-110b-chatOpenAlibaba1,155±327,476—
48▼ 3reka-flash-21b-20240226-onlineClosedReka AI1,151±516,026—
49▼ 3mixtral-8x22b-instruct-v0.1OpenMistral1,150±353,836—
50▼ 2qwen1.5-72b-chatOpenAlibaba1,148±340,642—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.