88.4
Claude 3.5 Sonnet
Anthropic
88.4
Composite Score
1272
Arena ELO
82 t/s
Output Speed
$15/M
Output Price
Benchmark Scores
Arena ELO
1272#14
IFEval
86.5%#10
MMLU
88.7%#9
GPQA
65%#8
AIME
16%#13
MATH
78.3%#12
HumanEval
92%#6
SWE-Bench
49%#8
LiveCodeBench
40.2%#12
MMMU
68.3%#11
Performance
380ms
Time to First Token
580 t/s
Input Speed
$3/M
Input Price
200K
Context Window
Model Details
ParametersNot disclosed
Knowledge Cutoff2024-04
Release Date2024-06-20
LicenseProprietary