Skip to content
IFAI

Model rankings

128 models · 1 boards · 1 sources

Artificial AnalysisIntelligence IndexArenaText arena

Text arena · Anonymous head-to-head votes · Published October 23, 2024

Most preferred
o1-previewOpenAI1,303Score
Best open model
Best from China
yi-lightning01 AI1,241Score
Most voted
claude-3-opus-20240229Anthropic176,723Votes
Top three by Score
1o1-previewOpenAI1,303
2gemini-1.5-pro-002Google1,268
3gpt-4o-2024-05-13OpenAI1,261
Top three open models
1llama-3.1-405b-instruct-fp8Meta · #7 overall1,251
2llama-3.1-405b-instruct-bf16Meta · #8 overall1,251
3mistral-large-2407Mistral · #19 overall1,230
RankChangeModelScore95% intervalVotesPrice $/M
1—o1-previewClosedOpenAI1,303±419,924—
2—gemini-1.5-pro-002ClosedGoogle1,268±513,957—
3—gpt-4o-2024-05-13ClosedOpenAI1,261±2101,733—
4▲ 1claude-3-5-sonnet-20240620ClosedAnthropic1,258±379,710—
5▼ 1o1-miniClosedOpenAI1,257±421,425—
6—gemini-advanced-0514ClosedGoogle1,252±452,236—
7—llama-3.1-405b-instruct-fp8OpenMeta1,251±241,936—
8—llama-3.1-405b-instruct-bf16OpenMeta1,251±414,603—
9—grok-2-2024-08-13ClosedxAI1,248±339,193—
10—gpt-4o-2024-08-06ClosedOpenAI1,248±333,550—
11—gpt-4-turbo-2024-04-09ClosedOpenAI1,241±398,456—
12Newgemini-1.5-pro-001ClosedGoogle1,239±382,659—
13—claude-3-opus-20240229ClosedAnthropic1,238±2176,723—
14—gpt-4-1106-previewClosedOpenAI1,234±2102,833—
15—gpt-4o-mini-2024-07-18ClosedOpenAI1,232±341,440—
16—gpt-4-0125-previewClosedOpenAI1,230±296,077—
17—gemini-1.5-flash-002ClosedGoogle1,226±511,155—
18—grok-2-mini-2024-08-13ClosedxAI1,222±432,949—
19—llama-3.1-70b-instructOpenMeta1,211±337,455—
20Newllama-3.1-nemotron-70b-instructOpenNVIDIA1,210±74,416—
21▼ 1gemma-2-27b-itOpenGoogle1,205±348,605—
22Newgemini-1.5-flash-001ClosedGoogle1,202±365,813—
23▼ 1gpt-4-0314ClosedOpenAI1,200±355,979—
24▼ 1claude-3-sonnet-20240229ClosedAnthropic1,197±2113,078—
25▼ 1nemotron-4-340b-instructOpenNVIDIA1,196±420,653—
26▼ 1llama-3-70b-instructOpenMeta1,194±2163,966—
27▼ 1gpt-4-0613ClosedOpenAI1,186±291,679—
28▼ 1claude-3-haiku-20240307ClosedAnthropic1,177±2120,679—
29—gemma-2-9b-itOpenGoogle1,176±335,939—
30▼ 2gemini-1.5-flash-8b-001ClosedGoogle1,176±512,232—
31▼ 1gemini-pro-dev-apiClosedGoogle1,147±418,789—
32▼ 1llama-3-8b-instructOpenMeta1,142±2109,383—
33▼ 1gpt-3.5-turbo-0125ClosedOpenAI · 1 more variant1,137±268,900—
34▼ 1gemini-proClosedGoogle1,131±76,562—
35▼ 1llama-3.1-8b-instructOpenMeta1,128±435,652—
36▼ 1phi-3-medium-4k-instructOpenMicrosoft1,118±426,155—
37▼ 1dbrx-instruct-previewOpenDatabricks1,113±333,736—
38▼ 1gemma-2-2b-itOpenGoogle1,109±427,446—
39▼ 1wizardlm-70bOpenMicrosoft1,105±68,383—
40▼ 1snowflake-arctic-instructOpenSnowflake1,103±434,194—
41▼ 1phi-3-small-8k-instructOpenMicrosoft1,098±418,503—
42▼ 1gemma-1.1-7b-itOpenGoogle1,098±425,087—
43▼ 1llama-3.2-3b-instructOpenMeta1,093±78,453—
44▼ 1llama-2-70b-chatOpenMeta1,081±339,636—
45▼ 1llama2-70b-steerlm-chatOpenNVIDIA1,074±103,640—
46▼ 1phi-3-mini-4k-instruct-june-2024OpenMicrosoft1,068±512,886—
47▼ 1wizardlm-13bOpenMicrosoft1,063±77,183—
48▼ 1phi-3-mini-4k-instructOpenMicrosoft1,055±421,119—
49▼ 1llama-2-13b-chatOpenMeta1,053±519,732—
50▼ 1phi-3-mini-128k-instructOpenMicrosoft1,049±421,616—

Intelligence over time

Each maker's best model at the time on the Artificial Analysis Intelligence Index, by the month it was released.

Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi

Arena data comes from the leaderboard dataset it publishes on Hugging Face (CC BY 4.0). Only each board's overall leaderboard is used; scores and ranks are unchanged. dataset · CC BY 4.0

Artificial Analysis data comes from its API (artificialanalysis.ai). Scores are unchanged; ranks follow the scores. artificialanalysis.ai

Open or closed follows the license Arena gives; prices and Artificial Analysis intelligence show only where model names match, otherwise “—”.