Benchmark avg
29.9
13 tracked scores
Model portfolio
Tap a star to rate
Anthropic · Released 2024-06-20 · v2024-06-20 · Closed · Context 200K tokens
Language Cap
135
Cadle Language Cap 135 · 45%
Benchmark average
—
Not enough benchmark results yet
Pricing
$3.00
$15.00 / 1M out
Only measured signals
Benchmark avg
29.9
13 tracked scores
Strongest signal
mmlu
Score 82.0
Blended $/1M
$18.00
In $3.00 · Out $15.00
Value index
1.7
Quality ÷ blended $/1M (higher is better)
Context
200K
Provider context window (not max output)
Measured matrix and verified gateway observations only.
PROVIDER
Anthropic
RELEASE
2024-06-20
CONTEXT
200K tokens
STATUS
ACTIVE
Real operator evaluations, prompt robustness observations, and deployment notes for claude-3-5-sonnet-20240620.
Tested claude-3-5-sonnet-20240620 on high-concurrency tool loops. Token generation remains consistent under sustained context load, with minimal prompt drift on complex JSON schemas.
Evaluated claude-3-5-sonnet-20240620 on multi-turn code synthesis. Code reasoning and diff application succeed on ~88% of test suites. Best paired with strict system prompt guardrails.
| Metric | |
|---|---|
| Provider | Anthropic |
| Release | 2024-06-20 |
| Input / 1M | $3.00 |
| Output / 1M | $15.00 |
| Context | 200K tokens |
| Cadle Cap | 135 |
| Cap board | Cadle Language Cap 135 |
| bigcodebench | 58.6 |
| mmlu | 82.0 |
| vpct | 0.0 |
| frontiermath-tier-4-2025-07-01-private | 0.0 |
| frontiermath-2025-02-28-private | 1.8 |
| metr-time-horizons | 40.1 |
| simplebench | 13.0 |
| cybench | 17.5 |
| weirdml | 31.0 |
| dtbench | 46.3 |
| otis-mock-aime-2024-2025 | 6.4 |
| math-level-5 | 51.7 |
Scores may use different scales — check the Benchmarks tab for source links.
Evidence linked to this model — listing, hub, benchmarks, or live gateway prices.
API
Anthropic listing