Model rankings
111 models · 1 boards · 1 sources
Week of August 26, 2024
Most preferred
Best open model
Best from China
Most voted
Top three by Score
chatgpt-4o-latestOpenAI1,289
gpt-4o-2024-05-13OpenAI1,261
claude-3-5-sonnet-20240620Anthropic1,258
Top three open models
llama-3.1-405b-instructMeta · #6 overall1,250
mistral-large-2407Mistral · #14 overall1,228
athene-70b-0725NexusFlow · #15 overall1,217
| Rank | Change | Model | Score | 95% interval | Votes | Price $/M |
|---|---|---|---|---|---|---|
| 1 | — | chatgpt-4o-latestClosedOpenAI | 1,289 | ±5 | 24,023 | — |
| 2 | — | gpt-4o-2024-05-13ClosedOpenAI | 1,261 | ±3 | 82,934 | — |
| 3 | — | claude-3-5-sonnet-20240620ClosedAnthropic | 1,258 | ±4 | 53,352 | — |
| 4 | — | gemini-advanced-0514ClosedGoogle | 1,251 | ±4 | 52,225 | — |
| 5 | — | grok-2-2024-08-13ClosedxAI | 1,250 | ±6 | 10,019 | — |
| 6 | — | llama-3.1-405b-instructOpenMeta | 1,250 | ±5 | 24,584 | — |
| 7 | — | gpt-4o-2024-08-06ClosedOpenAI | 1,245 | ±5 | 14,886 | — |
| 8 | — | gpt-4-turbo-2024-04-09ClosedOpenAI | 1,240 | ±3 | 88,005 | — |
| 9 | — | claude-3-opus-20240229ClosedAnthropic | 1,237 | ±3 | 159,592 | — |
| 10 | — | gemini-1.5-pro-api-0514ClosedGoogle | 1,236 | ±3 | 74,660 | — |
| 11 | — | gpt-4-1106-previewClosedOpenAI | 1,234 | ±3 | 94,283 | — |
| 12 | — | gpt-4o-mini-2024-07-18ClosedOpenAI | 1,231 | ±4 | 23,147 | — |
| 13 | — | gpt-4-0125-previewClosedOpenAI | 1,230 | ±3 | 87,597 | — |
| 14 | — | mistral-large-2407OpenMistral · 1 more variant | 1,228 | ±5 | 17,036 | — |
| 15 | — | athene-70b-0725OpenNexusFlow | 1,217 | ±5 | 15,167 | — |
| 16 | — | grok-2-mini-2024-08-13ClosedxAI | 1,216 | ±6 | 10,791 | — |
| 17 | — | llama-3.1-70b-instructOpenMeta | 1,210 | ±4 | 19,220 | — |
| 18 | — | gemma-2-27b-itOpenGoogle | 1,202 | ±4 | 31,513 | — |
| 19 | — | gpt-4-0314ClosedOpenAI | 1,201 | ±3 | 55,950 | — |
| 20 | — | gemini-1.5-flash-api-0514ClosedGoogle | 1,200 | ±3 | 59,852 | — |
| 21 | — | claude-3-sonnet-20240229ClosedAnthropic | 1,197 | ±2 | 113,031 | — |
| 22 | — | nemotron-4-340b-instructOpenNVIDIA | 1,195 | ±4 | 20,658 | — |
| 23 | — | jamba-1.5-largeOpenAI21 Labs | 1,193 | ±9 | 5,281 | — |
| 24 | — | llama-3-70b-instructOpenMeta | 1,193 | ±2 | 163,635 | — |
| 25 | — | glm-4-0520ClosedZhipu AI | 1,187 | ±6 | 10,230 | — |
| 26 | — | gpt-4-0613ClosedOpenAI | 1,187 | ±2 | 91,361 | — |
| 27 | — | command-r-plusOpenCohere | 1,182 | ±2 | 80,901 | — |
| 28 | — | deepseek-coder-v2OpenDeepSeek | 1,180 | ±5 | 15,790 | — |
| 29 | — | qwen2-72b-instructOpenAlibaba | 1,180 | ±3 | 36,278 | — |
| 30 | — | claude-3-haiku-20240307ClosedAnthropic | 1,176 | ±2 | 111,796 | — |
| 31 | — | gemma-2-9b-itOpenGoogle | 1,173 | ±4 | 27,150 | — |
| 32 | — | jamba-1.5-miniOpenAI21 Labs | 1,155 | ±9 | 5,266 | — |
| 33 | — | qwen1.5-110b-chatOpenAlibaba | 1,154 | ±4 | 27,474 | — |
| 34 | — | reka-flash-21b-20240226-onlineClosedReka AI | 1,151 | ±5 | 16,033 | — |
| 35 | — | mixtral-8x22b-instruct-v0.1OpenMistral | 1,148 | ±3 | 52,139 | — |
| 36 | — | qwen1.5-72b-chatOpenAlibaba | 1,148 | ±4 | 40,616 | — |
| 37 | — | command-rOpenCohere | 1,148 | ±3 | 56,371 | — |
| 38 | — | gemini-pro-dev-apiClosedGoogle | 1,147 | ±5 | 18,784 | — |
| 39 | — | mistral-mediumClosedMistral | 1,141 | ±3 | 35,547 | — |
| 40 | — | reka-flash-21b-20240226ClosedReka AI | 1,141 | ±4 | 25,785 | — |
| 41 | — | llama-3-8b-instructOpenMeta | 1,141 | ±3 | 109,023 | — |
| 42 | — | gpt-3.5-turbo-0125ClosedOpenAI · 1 more variant | 1,138 | ±2 | 68,884 | — |
| 43 | — | gemini-proClosedGoogle | 1,132 | ±8 | 6,560 | — |
| 44 | — | yi-1.5-34b-chatOpen01 AI | 1,131 | ±4 | 25,163 | — |
| 45 | — | zephyr-orpo-141b-A35b-v0.1OpenHuggingFace | 1,131 | ±7 | 4,855 | — |
| 46 | — | qwen1.5-32b-chatOpenAlibaba | 1,127 | ±5 | 22,755 | — |
| 47 | — | phi-3-medium-4k-instructOpenMicrosoft | 1,118 | ±4 | 24,305 | — |
| 48 | — | llama-3.1-8b-instructOpenMeta | 1,117 | ±4 | 18,335 | — |
| 49 | — | mixtral-8x7b-instruct-v0.1OpenMistral | 1,114 | ±0 | 76,119 | — |
| 50 | — | dbrx-instruct-previewOpenDatabricks | 1,113 | ±4 | 33,728 | — |
Intelligence over time
Gained most · Anthropic +57.2Highest now · Anthropic 64.6Gap between highest and lowest 18.1 ptsTime range Nov 2025 – Nov 2026
64.6Anthropic60.0Google56.9OpenAI50.1Meta46.5Kimi