Benchmark
GPQA
Graduate-Level Google-Proof QA
Expert-level questions across physics, chemistry, biology that resist search-engine retrieval.
25
Models Tested
Gemini 2.5 Pro
Top Model
84%
Top Score
100 %
Max Possible
| # | Model | GPQA Score |
|---|---|---|
| 1 | Gemini 2.5 Pro Google | 84% |
| 2 | Claude Opus 4 Anthropic | 83.5% |
| 3 | o3 OpenAI | 81.3% |
| 4 | o4-mini OpenAI | 72.1% |
| 5 | DeepSeek R1 DeepSeek | 71.5% |
| 6 | Claude Sonnet 4 Anthropic | 70.2% |
| 7 | Grok 3 xAI | 68.5% |
| 8 | Claude 3.5 Sonnet Anthropic | 65% |
| 9 | Llama 4 Maverick Meta | 62.8% |
| 10 | Gemini 2.5 Flash Google | 62.3% |
| 11 | DeepSeek V3 DeepSeek | 59.1% |
| 12 | Qwen 3 235B Alibaba | 58.3% |
| 13 | Gemini 2.0 Flash Google | 55.4% |
| 14 | GPT-4o OpenAI | 53.6% |
| 15 | Llama 3.1 405B Meta | 51.1% |
| 16 | Llama 3.3 70B Meta | 48.7% |
| 17 | Claude 3.5 Haiku Anthropic | 48.2% |
| 18 | Mistral Large Mistral AI | 46.5% |
| 19 | Qwen 2.5 72B Alibaba | 45.6% |
| 20 | Grok 2 xAI | 44.8% |
| 21 | Llama 3.1 70B Meta | 42.3% |
| 22 | GPT-4o Mini OpenAI | 41.1% |
| 23 | Phi-4 Microsoft | 38.5% |
| 24 | Mixtral 8x22B Mistral AI | 33.5% |
| 25 | Command R+ Cohere | 30.2% |
Source: Rein et al., 2023