Benchmark avg
55.5
10 tracked scores
Model portfolio
Tap a star to rate
Google · Released 2024-02-15 · v2024-02-15 · Closed · Context 2M tokens
Language Cap
128
Cadle Language Cap 128 · 45%
Benchmark average
—
Not enough benchmark results yet
Pricing
$3.50
$10.50 / 1M out
Only measured signals
Benchmark avg
55.5
10 tracked scores
Strongest signal
mmlu
Score 85.9
Blended $/1M
$14.00
In $3.50 · Out $10.50
Value index
4.0
Quality ÷ blended $/1M (higher is better)
Context
2M
Provider context window (not max output)
Measured matrix and verified gateway observations only.
PROVIDER
RELEASE
2024-02-15
CONTEXT
2M tokens
STATUS
ACTIVE
Real operator evaluations, prompt robustness observations, and deployment notes for gemini-1.5-pro-001.
Tested gemini-1.5-pro-001 on high-concurrency tool loops. Token generation remains consistent under sustained context load, with minimal prompt drift on complex JSON schemas.
Evaluated gemini-1.5-pro-001 on multi-turn code synthesis. Code reasoning and diff application succeed on ~88% of test suites. Best paired with strict system prompt guardrails.
| Metric | |
|---|---|
| Provider | |
| Release | 2024-02-15 |
| Input / 1M | $3.50 |
| Output / 1M | $10.50 |
| Context | 2M tokens |
| Cadle Cap | 128 |
| Cap board | Cadle Language Cap 128 |
| humaneval | 84.1 |
| math-500 | 67.7 |
| gpqa-diamond | 46.2 |
| mmlu | 85.9 |
| bbh | 85.6 |
| dtbench | 27.4 |
| otis-mock-aime-2024-2025 | 6.7 |
| math-level-5 | 40.8 |
Scores may use different scales — check the Benchmarks tab for source links.
Evidence linked to this model — listing, hub, benchmarks, or live gateway prices.
API
Google listing
Source: Epoch AI (CC BY 4.0) · as of 2026-10-30 · All credits