ARC-AGI-3 Leaderboard
ARC-AGI-1
ARC-AGI-2
ARC-AGI-3
Author:
All Authors
All Authors
ARC Prize 2024only
ARC Prize 2025only
Alibabaonly
Anthropiconly
Bespokeonly
Deepseekonly
E. Pangonly
Googleonly
J. Bermanonly
Johan Landonly
Metaonly
Minimaxonly
Mistralonly
Moonshot AIonly
OpenAIonly
Poetiqonly
Z.aionly
xAIonly
Model type:
All Types
All Types
only
Base LLMonly
CoTonly
CoT + Synthesisonly
Customonly
Refinementonly
Model:
All Models
Understanding the Leaderboard
ARC-AGI has evolved from its first versions (ARC-AGI-1 and 2) which measured passive fluid intelligence, to ARC-AGI-3 which challenges AI agents to adapt on the fly to novel interactive environments.
The scatter plot above visualizes the critical relationship between cost-per-task and performance - a key measure of efficiency. True intelligence isn't just about solving problems, but solving them efficiently with minimal resources.
Interpreting the data
- Reasoning Systems Trend Line solutions display connected points representing the same model at different reasoning levels. These trend lines illustrate how increased reasoning time affects performance, typically showing asymptotic behavior as thinking time increases.
- Base LLMs solutions represent single-shot inference from standard language models like GPT-4.5 and Claude 3.7, without extended reasoning capabilities. These points demonstrate raw model performance without additional reasoning enhancements.
- Kaggle Systems solutions showcase competition-grade submissions from the Kaggle challenge, operating under strict computational constraints ($50 compute budget for 120 evaluation tasks). These represent purpose-built, efficient methods specifically designed for the ARC Prize.
Verification Policy
For more information, see our testing policy.
Leaderboard Breakdown
| AI System | Author | Date | System Type | ARC-AGI-1 | ARC-AGI-2 | ARC-AGI-3 | Cost/Task | Cost (V3) | Code / Paper |
|---|---|---|---|---|---|---|---|---|---|
| GPT-5.6 Sol (Low) | OpenAI | 2026-07-09 | CoT | 74.5% | 42.5% | 0.3% | $0.320 | $12.8K | — |
| GPT-5.6 Sol (Medium) | OpenAI | 2026-07-09 | CoT | 92.5% | 67.1% | 1.1% | $0.470 | $13.0K | — |
| GPT-5.6 Sol (High) | OpenAI | 2026-07-09 | CoT | 97.0% | 85.4% | 2.1% | $0.740 | $15.2K | — |
| GPT-5.6 Sol (xHigh) | OpenAI | 2026-07-09 | CoT | 97.5% | 90.0% | 7.0% | $1.04 | $19.2K | — |
| GPT-5.6 Sol (Max) | OpenAI | 2026-07-09 | CoT | 96.5% | 92.5% | 7.8% | $1.44 | $25.1K | — |
| GPT-5.6 Terra (Low) | OpenAI | 2026-07-09 | CoT | 60.2% | 18.8% | 0.0% | $0.170 | $5.1K | — |
| GPT-5.6 Terra (Medium) | OpenAI | 2026-07-09 | CoT | 77.0% | 37.5% | 0.1% | $0.270 | $5.9K | — |
| GPT-5.6 Terra (High) | OpenAI | 2026-07-09 | CoT | 92.0% | 67.1% | 0.5% | $0.550 | $5.9K | — |
| GPT-5.6 Terra (xHigh) | OpenAI | 2026-07-09 | CoT | 94.0% | 74.2% | 0.7% | $0.690 | $6.8K | — |
| GPT-5.6 Terra (Max) | OpenAI | 2026-07-09 | CoT | 96.5% | 83.9% | 0.8% | $1.09 | $7.9K | — |
| GPT-5.6 Luna (Low) | OpenAI | 2026-07-09 | CoT | 34.2% | 5.1% | 0.2% | $0.070 | $2.3K | — |
| GPT-5.6 Luna (Medium) | OpenAI | 2026-07-09 | CoT | 56.5% | 7.4% | 0.2% | $0.110 | $2.4K | — |
| GPT-5.6 Luna (High) | OpenAI | 2026-07-09 | CoT | 76.5% | 29.3% | 0.1% | $0.290 | $2.5K | — |
| GPT-5.6 Luna (xHigh) | OpenAI | 2026-07-09 | CoT | 87.7% | 47.6% | 0.0% | $0.540 | $2.8K | — |
| GPT-5.6 Luna (Max) | OpenAI | 2026-07-09 | CoT | 88.0% | 59.5% | 0.2% | $0.670 | $3.2K | — |
| GLM-5.2 | Z.ai | 2026-06-13 | CoT | 77.0% | 22.8% | N/A | $0.250 | N/A | — |
| Claude Opus 4.8 (Low) | Anthropic | 2026-06-01 | CoT | 88.0% | 62.2% | N/A | $1.68 | N/A | — |
| Claude Opus 4.8 (Medium) | Anthropic | 2026-06-01 | CoT | 91.5% | 71.7% | N/A | $2.39 | N/A | — |
| Claude Opus 4.8 (High) | Anthropic | 2026-06-01 | CoT | 92.0% | 72.1% | 1.5% | $2.74 | $10.0K | — |
| Claude Opus 4.8 (Max) | Anthropic | 2026-06-01 | CoT | 92.5% | N/A | N/A | $2.33 | N/A | — |
| Gemini 3.5 Flash (Minimal) | 2026-05-19 | CoT | 48.8% | 8.9% | N/A | $0.107 | N/A | — | |
| Gemini 3.5 Flash (High) | 2026-05-19 | CoT | 92.5% | 72.1% | N/A | $0.850 | N/A | — | |
| GPT-5.5 Pro (High) | OpenAI | 2026-04-23 | CoT | 96.5% | 84.6% | N/A | $10.51 | N/A | — |
| GPT-5.5 Pro (xHigh) | OpenAI | 2026-04-23 | CoT | 95.0% | 84.2% | N/A | $10.76 | N/A | — |
| GPT-5.5 (High) | OpenAI | 2026-04-23 | CoT | N/A | N/A | 0.4% | N/A | $10.0K | — |
| GPT-5.5 (Low) | OpenAI | 2026-04-22 | CoT | 76.2% | 33.3% | N/A | $0.350 | N/A | — |
| GPT-5.5 (Medium) | OpenAI | 2026-04-22 | CoT | 92.2% | 70.4% | N/A | $0.860 | N/A | — |
| GPT-5.5 (High) | OpenAI | 2026-04-22 | CoT | 94.5% | 83.3% | N/A | $1.45 | N/A | — |
| GPT-5.5 (xHigh) | OpenAI | 2026-04-22 | CoT | 95.0% | 85.0% | N/A | $1.87 | N/A | — |
| Claude 4.7 (Low) | Anthropic | 2026-04-16 | CoT | 91.0% | 62.1% | N/A | $2.38 | N/A | — |
| Claude 4.7 (Medium) | Anthropic | 2026-04-16 | CoT | 91.0% | 67.5% | N/A | $2.96 | N/A | — |
| Claude 4.7 (High) | Anthropic | 2026-04-16 | CoT | 93.5% | 68.3% | N/A | $3.17 | N/A | — |
| Claude 4.7 (Max) | Anthropic | 2026-04-16 | CoT | 92.0% | 75.8% | N/A | $7.43 | N/A | — |
| Opus 4.7 (High) | Anthropic | 2026-04-16 | CoT | N/A | N/A | 0.2% | N/A | $10.0K | — |
| GPT-5.4 Mini (xHigh) | OpenAI | 2026-03-17 | CoT | 63.7% | 18.9% | N/A | $0.750 | N/A | — |
| GPT-5.4 Mini (High) | OpenAI | 2026-03-17 | CoT | 58.0% | 13.2% | N/A | $0.560 | N/A | — |
| GPT-5.4 Mini (Medium) | OpenAI | 2026-03-17 | CoT | 40.8% | 4.4% | N/A | $0.330 | N/A | — |
| GPT-5.4 Mini (Low) | OpenAI | 2026-03-17 | CoT | 13.0% | 1.1% | N/A | $0.060 | N/A | — |
| GPT-5.4 Nano (xHigh) | OpenAI | 2026-03-17 | CoT | 51.5% | 5.7% | N/A | $0.160 | N/A | — |
| GPT-5.4 Nano (High) | OpenAI | 2026-03-17 | CoT | 38.2% | 3.6% | N/A | $0.130 | N/A | — |
| GPT-5.4 Nano (Medium) | OpenAI | 2026-03-17 | CoT | 33.0% | 1.9% | N/A | $0.060 | N/A | — |
| GPT-5.4 Nano (Low) | OpenAI | 2026-03-17 | CoT | 18.3% | 1.5% | N/A | $0.010 | N/A | — |
| Grok 4.20 (Reasoning) | xAI | 2026-03-09 | CoT | 89.5% | 65.1% | N/A | $0.920 | N/A | — |
| Grok 4.20 (Beta Reasoning) | xAI | 2026-03-05 | CoT | N/A | N/A | 0.1% | N/A | $3.8K | — |
| GPT-5.4 (High) | OpenAI | 2026-03-05 | CoT | N/A | N/A | 0.2% | N/A | $5.2K | — |
| Gemini 3.1 Pro (Preview) | 2026-03-05 | CoT | N/A | N/A | 0.4% | N/A | $2.2K | — | |
| GPT-5.4 (Low) | OpenAI | 2026-03-04 | CoT | 68.2% | 29.2% | N/A | $0.270 | N/A | — |
| GPT-5.4 (Medium) | OpenAI | 2026-03-04 | CoT | 86.2% | 55.4% | N/A | $0.680 | N/A | — |
| GPT-5.4 (High) | OpenAI | 2026-03-04 | CoT | 92.7% | 67.5% | N/A | $1.02 | N/A | — |
| GPT-5.4 (xHigh) | OpenAI | 2026-03-04 | CoT | 93.7% | 74.0% | N/A | $1.52 | N/A | — |
| GPT-5.4 Pro (xHigh) | OpenAI | 2026-03-04 | CoT | 94.5% | 83.3% | N/A | $16.41 | N/A | — |
| GLM-5 | Z.ai | 2026-02-20 | CoT | 44.7% | 4.9% | N/A | $0.270 | N/A | — |
| Gemini 3.1 Pro (Preview) | 2026-02-19 | CoT | 98.0% | 77.1% | N/A | $0.962 | N/A | 📄 | |
| Claude Sonnet 4.6 (Max) | Anthropic | 2026-02-17 | CoT | 86.0% | 58.3% | N/A | $2.72 | N/A | — |
| Claude Sonnet 4.6 (High) | Anthropic | 2026-02-17 | CoT | 86.5% | 60.4% | N/A | $2.70 | N/A | — |
| Gemini 3 Deep Think (Preview) ² | 2026-02-12 | CoT | 87.5% | 45.1% | N/A | $77.16 | N/A | — | |
| Gemini 3 Deep Think (2/26) | 2026-02-12 | CoT | 96.0% | 84.6% | N/A | $13.62 | N/A | — | |
| Minimax M2.5 | Minimax | 2026-02-12 | CoT | 63.7% | 4.9% | N/A | $0.170 | N/A | — |
| Claude Opus 4.6 (120K, Low) | Anthropic | 2026-02-05 | CoT | 86.0% | 64.6% | N/A | $2.25 | N/A | — |
| Claude Opus 4.6 (120K, Medium) | Anthropic | 2026-02-05 | CoT | 92.0% | 66.3% | N/A | $2.72 | N/A | — |
| Claude Opus 4.6 (120K, High) | Anthropic | 2026-02-05 | CoT | 94.0% | 69.2% | N/A | $3.47 | N/A | — |
| Claude Opus 4.6 (120K, Max) | Anthropic | 2026-02-05 | CoT | 93.0% | 68.8% | N/A | $3.64 | N/A | — |
| GPT-5.2 (Refine.) | Johan Land | 2026-02-03 | Refinement | 94.5% | 72.9% | N/A | $38.99 | N/A | 📄💻 |
| Kimi K2.5 | Moonshot AI | 2026-01-27 | CoT | 65.3% | 11.8% | N/A | $0.280 | N/A | — |
| Gemini 3 Flash Preview (Minimal) | 2025-12-17 | CoT | 21.5% | 3.3% | N/A | $0.021 | N/A | — | |
| Gemini 3 Flash Preview (Low) | 2025-12-17 | CoT | 29.0% | 1.3% | N/A | $0.025 | N/A | — | |
| Gemini 3 Flash Preview (Medium) | 2025-12-17 | CoT | 57.7% | 12.8% | N/A | $0.082 | N/A | — | |
| Gemini 3 Flash Preview (High) | 2025-12-17 | CoT | 84.7% | 33.6% | N/A | $0.231 | N/A | — | |
| Anthropic Opus 4.6 (Max) | Anthropic | 2025-12-17 | CoT | N/A | N/A | 0.5% | N/A | $8.9K | — |
| GPT-5.2 | OpenAI | 2025-12-11 | Base LLM | 12.3% | 0.8% | N/A | $0.082 | N/A | — |
| GPT-5.2 (Low) | OpenAI | 2025-12-11 | CoT | 55.7% | 9.7% | N/A | $0.264 | N/A | — |
| GPT-5.2 (Medium) | OpenAI | 2025-12-11 | CoT | 72.7% | 26.7% | N/A | $0.759 | N/A | — |
| GPT-5.2 (High) | OpenAI | 2025-12-11 | CoT | 78.7% | 43.3% | N/A | $1.39 | N/A | — |
| GPT-5.2 (xHigh) | OpenAI | 2025-12-11 | CoT | 86.2% | 52.9% | N/A | $1.90 | N/A | — |
| GPT-5.2 Pro (Medium) | OpenAI | 2025-12-11 | CoT | 81.2% | 38.5% | N/A | $8.99 | N/A | — |
| GPT-5.2 Pro (High) | OpenAI | 2025-12-11 | CoT | 85.7% | 54.2% | N/A | $15.72 | N/A | — |
| GPT-5.2 Pro (xHigh) | OpenAI | 2025-12-11 | CoT | 90.5% | N/A | N/A | $11.65 | N/A | — |
| Gemini 3 Pro (Refine.) | Poetiq | 2025-12-04 | Refinement | N/A | 54.0% | N/A | $30.57 | N/A | — |
| Deepseek V3.2 | Deepseek | 2025-12-01 | Base LLM | 57.0% | 4.0% | N/A | $0.120 | N/A | — |
| Opus 4.5 (Thinking, None) | Anthropic | 2025-11-24 | CoT | 40.0% | 7.8% | N/A | $0.220 | N/A | — |
| Opus 4.5 (Thinking, 1K) | Anthropic | 2025-11-24 | CoT | 35.2% | 9.4% | N/A | $0.230 | N/A | — |
| Opus 4.5 (Thinking, 8K) | Anthropic | 2025-11-24 | CoT | 58.7% | 13.9% | N/A | $0.480 | N/A | — |
| Opus 4.5 (Thinking, 16K) | Anthropic | 2025-11-24 | CoT | 72.0% | 22.8% | N/A | $0.790 | N/A | — |
| Opus 4.5 (Thinking, 32K) | Anthropic | 2025-11-24 | CoT | 75.8% | 30.6% | N/A | $1.29 | N/A | — |
| Opus 4.5 (Thinking, 64K) | Anthropic | 2025-11-24 | CoT | 80.0% | 37.6% | N/A | $2.40 | N/A | — |
| Gemini 3 Pro | 2025-11-18 | CoT | 75.0% | 31.1% | N/A | $0.811 | N/A | — | |
| GPT-5.1 (Thinking, None) | OpenAI | 2025-11-13 | CoT | 5.8% | 0.4% | N/A | $0.058 | N/A | — |
| GPT-5.1 (Thinking, Low) | OpenAI | 2025-11-13 | CoT | 33.2% | 1.9% | N/A | $0.129 | N/A | — |
| GPT-5.1 (Thinking, Medium) | OpenAI | 2025-11-13 | CoT | 57.7% | 6.5% | N/A | $0.421 | N/A | — |
| GPT-5.1 (Thinking, High) | OpenAI | 2025-11-13 | CoT | 72.8% | 17.6% | N/A | $1.17 | N/A | — |
| Grok 4 (Fast Reasoning) | xAI | 2025-10-21 | CoT | 48.5% | 5.3% | N/A | $0.061 | N/A | 📄 |
| Tiny Recursion Model (TRM) | Bespoke | 2025-10-07 | N/A | 40.0% | 6.3% | N/A | $2.10 | N/A | 📄💻 |
| GPT-5 Pro | OpenAI | 2025-10-06 | CoT | 70.2% | 18.3% | N/A | $7.14 | N/A | 📄 |
| Claude Haiku 4.5 | Anthropic | 2025-10-01 | Base LLM | 14.3% | 1.3% | N/A | $0.043 | N/A | 📄 |
| Claude Haiku 4.5 (Thinking 1K) | Anthropic | 2025-10-01 | CoT | 16.8% | 1.3% | N/A | $0.047 | N/A | 📄 |
| Claude Haiku 4.5 (Thinking 8K) | Anthropic | 2025-10-01 | CoT | 25.5% | 1.7% | N/A | $0.091 | N/A | 📄 |
| Claude Haiku 4.5 (Thinking 16K) | Anthropic | 2025-10-01 | CoT | 37.3% | 2.8% | N/A | $0.139 | N/A | 📄 |
| Claude Haiku 4.5 (Thinking 32K) | Anthropic | 2025-10-01 | CoT | 47.7% | 4.0% | N/A | $0.377 | N/A | 📄 |
| Claude Sonnet 4.5 | Anthropic | 2025-09-29 | Base LLM | 25.5% | 3.8% | N/A | $0.130 | N/A | 📄 |
| Claude Sonnet 4.5 (Thinking 1K) | Anthropic | 2025-09-29 | CoT | 31.0% | 5.8% | N/A | $0.142 | N/A | 📄 |
| Claude Sonnet 4.5 (Thinking 8K) | Anthropic | 2025-09-29 | CoT | 46.5% | 6.9% | N/A | $0.235 | N/A | 📄 |
| Claude Sonnet 4.5 (Thinking 16K) | Anthropic | 2025-09-29 | CoT | 48.3% | 6.9% | N/A | $0.350 | N/A | 📄 |
| Claude Sonnet 4.5 (Thinking 32K) | Anthropic | 2025-09-29 | CoT | 63.7% | 13.6% | N/A | $0.759 | N/A | 📄 |
| GPT-5 (High) | OpenAI | 2025-08-07 | CoT | 65.7% | 9.9% | N/A | $0.730 | N/A | — |
| GPT-5 (Medium) | OpenAI | 2025-08-07 | CoT | 56.2% | 7.5% | N/A | $0.449 | N/A | — |
| GPT-5 (Low) | OpenAI | 2025-08-07 | CoT | 44.0% | 1.9% | N/A | $0.190 | N/A | — |
| GPT-5 (Minimal) | OpenAI | 2025-08-07 | Base LLM | 6.0% | 0.0% | N/A | $0.056 | N/A | — |
| GPT-5 Mini (High) | OpenAI | 2025-08-07 | CoT | 54.3% | 4.4% | N/A | $0.198 | N/A | — |
| GPT-5 Mini (Medium) | OpenAI | 2025-08-07 | CoT | 37.3% | 4.0% | N/A | $0.063 | N/A | — |
| GPT-5 Mini (Low) | OpenAI | 2025-08-07 | CoT | 26.3% | 0.8% | N/A | $0.019 | N/A | — |
| GPT-5 Mini (Minimal) | OpenAI | 2025-08-07 | CoT | 5.3% | 1.7% | N/A | $0.009 | N/A | — |
| GPT-5 Nano (High) | OpenAI | 2025-08-07 | CoT | 16.7% | 2.6% | N/A | $0.029 | N/A | — |
| GPT-5 Nano (Medium) | OpenAI | 2025-08-07 | CoT | 20.7% | 0.9% | N/A | $0.014 | N/A | — |
| GPT-5 Nano (Low) | OpenAI | 2025-08-07 | CoT | 4.0% | 0.0% | N/A | $0.003 | N/A | — |
| GPT-5 Nano (Minimal) | OpenAI | 2025-08-07 | CoT | 1.5% | 0.0% | N/A | $0.003 | N/A | — |
| Hierarchical Reasoning Model (HRM) | Bespoke | 2025-08-07 | N/A | 32.0% | 2.0% | N/A | $1.68 | N/A | — |
| Grok 4 (Refine.) | J. Berman | 2025-08-07 | Refinement | 79.6% | 29.4% | N/A | $30.40 | N/A | 💻 |
| Grok 4 (Refine.) | E. Pang | 2025-08-07 | Refinement | 77.1% | 26.0% | N/A | $3.97 | N/A | 💻 |
| Qwen3-235b-a22b Instruct (25/07) | Alibaba | 2025-07-25 | Base LLM | 11.0% | 1.3% | N/A | $0.004 | N/A | 📄 |
| Grok 4 (Thinking) | xAI | 2025-07-09 | CoT | 66.7% | 16.0% | N/A | $2.17 | N/A | 📄 |
| Gemini 2.5 Pro (Thinking 1K) | 2025-06-17 | CoT | 16.0% | 0.0% | N/A | $0.088 | N/A | 📄 | |
| Gemini 2.5 Pro (Thinking 8K) | 2025-06-17 | CoT | 29.5% | 2.9% | N/A | $0.444 | N/A | 📄 | |
| Gemini 2.5 Pro (Thinking 16K) | 2025-06-17 | CoT | 41.0% | 4.0% | N/A | $0.715 | N/A | 📄 | |
| Gemini 2.5 Pro (Thinking 32K) | 2025-06-17 | CoT | 37.0% | 4.9% | N/A | $0.757 | N/A | 📄 | |
| o3-Pro (Low) | OpenAI | 2025-06-10 | CoT + Synthesis | 44.3% | 2.1% | N/A | $2.23 | N/A | 📄 |
| o3-Pro (Medium) | OpenAI | 2025-06-10 | CoT + Synthesis | 57.0% | 1.9% | N/A | $4.74 | N/A | 📄 |
| o3-Pro (High) | OpenAI | 2025-06-10 | CoT + Synthesis | 59.3% | 4.9% | N/A | $7.55 | N/A | 📄 |
| Magistral Small | Mistral | 2025-06-10 | CoT | 5.0% | 0.0% | N/A | $0.049 | N/A | 📄 |
| Magistral Medium | Mistral | 2025-06-10 | CoT | 5.9% | 0.0% | N/A | $0.108 | N/A | 📄 |
| Magistral Medium (Thinking) | Mistral | 2025-06-10 | CoT | 6.1% | 0.0% | N/A | $0.123 | N/A | 📄 |
| Deepseek R1 (05/28) | Deepseek | 2025-05-28 | CoT | 21.2% | 1.1% | N/A | $0.053 | N/A | 📄 |
| Codex Mini (Latest) | OpenAI | 2025-05-23 | CoT | 27.3% | 1.3% | N/A | $0.230 | N/A | 📄 |
| Gemini 2.5 Flash (Preview) | 2025-05-20 | CoT | 33.3% | 1.7% | N/A | $0.057 | N/A | 📄💻 | |
| Gemini 2.5 Flash (Preview) (Thinking 1K) | 2025-05-20 | CoT | 16.0% | 2.2% | N/A | $0.030 | N/A | 📄💻 | |
| Gemini 2.5 Flash (Preview) (Thinking 8K) | 2025-05-20 | CoT | 25.8% | 2.1% | N/A | $0.199 | N/A | 📄💻 | |
| Gemini 2.5 Flash (Preview) (Thinking 16K) | 2025-05-20 | CoT | 33.3% | 2.0% | N/A | $0.317 | N/A | 📄💻 | |
| Gemini 2.5 Flash (Preview) (Thinking 24K) | 2025-05-20 | CoT | 32.3% | 2.5% | N/A | $0.319 | N/A | 📄💻 | |
| Claude Sonnet 4 | Anthropic | 2025-05-14 | Base LLM | 23.8% | 1.3% | N/A | $0.127 | N/A | 📄 |
| Claude Sonnet 4 (Thinking 1K) | Anthropic | 2025-05-14 | CoT | 28.0% | 0.9% | N/A | $0.142 | N/A | 📄 |
| Claude Sonnet 4 (Thinking 8K) | Anthropic | 2025-05-14 | CoT | 29.0% | 2.1% | N/A | $0.265 | N/A | 📄 |
| Claude Sonnet 4 (Thinking 16K) | Anthropic | 2025-05-14 | CoT | 40.0% | 5.9% | N/A | $0.486 | N/A | 📄 |
| Claude Opus 4 (Thinking 16K) | Anthropic | 2025-05-14 | CoT | 35.7% | 8.6% | N/A | $1.93 | N/A | 📄 |
| Claude Opus 4 (Thinking 8K) | Anthropic | 2025-05-14 | CoT | 30.7% | 4.5% | N/A | $1.16 | N/A | 📄 |
| Claude Opus 4 (Thinking 1K) | Anthropic | 2025-05-14 | CoT | 27.0% | 0.0% | N/A | $0.750 | N/A | 📄 |
| Claude Opus 4 | Anthropic | 2025-05-14 | CoT | 22.5% | 1.3% | N/A | $0.639 | N/A | 📄 |
| o3 (Low) | OpenAI | 2025-04-16 | CoT | 41.5% | 2.0% | N/A | $0.234 | N/A | — |
| o3 (Medium) | OpenAI | 2025-04-16 | CoT | 53.8% | 3.0% | N/A | $0.479 | N/A | — |
| o3 (High) | OpenAI | 2025-04-16 | CoT | 60.8% | 6.5% | N/A | $0.834 | N/A | — |
| o4-mini (Low) | OpenAI | 2025-04-16 | CoT | 21.3% | 1.7% | N/A | $0.050 | N/A | — |
| o4-mini (Medium) | OpenAI | 2025-04-16 | CoT | 41.8% | 2.4% | N/A | $0.231 | N/A | — |
| o4-mini (High) | OpenAI | 2025-04-16 | CoT | 58.7% | 6.1% | N/A | $0.856 | N/A | — |
| GPT-4.1-Nano | OpenAI | 2025-04-14 | Base LLM | 0.0% | 0.0% | N/A | $0.004 | N/A | 📄💻 |
| GPT-4.1-Mini | OpenAI | 2025-04-14 | Base LLM | 3.5% | 0.0% | N/A | $0.014 | N/A | 📄💻 |
| GPT-4.1 | OpenAI | 2025-04-14 | Base LLM | 5.5% | 0.4% | N/A | $0.069 | N/A | 📄💻 |
| Llama 4 Maverick | Meta | 2025-04-05 | Base LLM | 4.4% | 0.0% | N/A | $0.012 | N/A | 📄💻 |
| Llama 4 Scout | Meta | 2025-04-05 | Base LLM | 0.5% | 0.0% | N/A | $0.006 | N/A | 📄💻 |
| GPT-4.5 | OpenAI | 2025-02-27 | Base LLM | 10.3% | 0.8% | N/A | $2.10 | N/A | 💻 |
| Claude 3.7 | Anthropic | 2025-02-24 | Base LLM | 13.6% | 0.0% | N/A | $0.120 | N/A | 💻 |
| Claude 3.7 (16K) | Anthropic | 2025-02-24 | CoT | 28.6% | 0.7% | N/A | $0.510 | N/A | 💻 |
| Claude 3.7 (1K) | Anthropic | 2025-02-24 | CoT | 11.6% | 0.4% | N/A | $0.140 | N/A | 💻 |
| Claude 3.7 (8K) | Anthropic | 2025-02-24 | CoT | 21.2% | 0.9% | N/A | $0.360 | N/A | 💻 |
| Grok 3 | xAI | 2025-02-19 | Base LLM | 5.5% | 0.0% | N/A | $0.142 | N/A | 📄 |
| Grok 3 Mini (Low) | xAI | 2025-02-19 | CoT | 16.5% | 0.4% | N/A | $0.013 | N/A | 📄 |
| Gemini 2.5 Pro (Preview) | 2025-02-19 | CoT | 33.0% | 3.8% | N/A | $0.813 | N/A | 📄 | |
| Gemini 2.5 Pro (Preview, Thinking 1K) | 2025-02-19 | CoT | 31.3% | 3.4% | N/A | $0.804 | N/A | 📄 | |
| Gemini 1.5 Pro | 2025-02-15 | Base LLM | N/A | 0.8% | N/A | $0.040 | N/A | 💻 | |
| Gemini 2.0 Flash | 2025-02-02 | Base LLM | N/A | 1.3% | N/A | $0.004 | N/A | 💻 | |
| o3-mini (Low) | OpenAI | 2025-01-31 | CoT | 14.5% | 0.0% | N/A | $0.062 | N/A | — |
| o3-mini (Medium) | OpenAI | 2025-01-31 | CoT | 22.3% | 2.1% | N/A | $0.284 | N/A | — |
| o3-mini (High) | OpenAI | 2025-01-31 | CoT | 34.5% | 3.0% | N/A | $0.547 | N/A | — |
| Deepseek R1 | Deepseek | 2025-01-22 | CoT | 15.8% | 1.3% | N/A | $0.080 | N/A | 💻 |
| o3 (Preview, Low) ¹ | OpenAI | 2024-12-20 | CoT + Synthesis | 75.7% | 4.0% | N/A | $200.00 | N/A | 📄 |
| GPT-4o | OpenAI | 2024-11-20 | Base LLM | 4.5% | 0.0% | N/A | $0.080 | N/A | 💻 |
| ARChitects | ARC Prize 2024 | 2024-11-03 | Custom | 56.0% | 2.5% | N/A | $0.200 | N/A | 📄💻 |
| NVARC | ARC Prize 2025 | 2024-11-03 | Custom | N/A | 27.6% | N/A | $0.200 | N/A | 📄💻 |
| o1-mini | OpenAI | 2024-09-12 | CoT | 14.0% | 0.8% | N/A | $0.191 | N/A | 📄💻 |
| GPT-4o-mini | OpenAI | 2024-07-18 | Base LLM | N/A | 0.0% | N/A | $0.010 | N/A | 💻 |
| Icecuber | ARC Prize 2024 | 2023-11-03 | Custom | 17.0% | 1.6% | N/A | $0.130 | N/A | 💻 |
| Human Panel | Human | N/A | N/A | 98.0% | 100.0% | N/A | $17.00 | N/A | — |
| Avg. Mturker | Human | N/A | N/A | 77.0% | N/A | N/A | $3.00 | N/A | — |
| Stem Grad | Human | N/A | N/A | 98.0% | N/A | N/A | $10.00 | N/A | — |
Notes
Only systems which required less than $10,000 to run are shown.
For models that were not able to produce full test out puts, remaining tasks were marked as incorrect.
Results marked as "preview" are unofficial and may be based on incomplete testing.
1 ARC-AGI-2 score estimate based on partial testing results and o1-pro pricing.
2 Provisional cost estimates based on Gemini 3 Pro pricing. Model to be retested once released.