Benchmark avg
37.0
6 tracked scores
Model portfolio
Tap a star to rate
Google · Released 2024-05-14 · v2024-05-14 · Closed · Context 1M tokens
Language Cap
123
Cadle Language Cap 123 · 45%
Benchmark average
—
Not enough benchmark results yet
Pricing
$0.075
$0.30 / 1M out
Only measured signals
Benchmark avg
37.0
6 tracked scores
Strongest signal
gsm8k
Score 82.4
Blended $/1M
$0.38
In $0.075 · Out $0.30
Value index
98.7
Quality ÷ blended $/1M (higher is better)
Context
1M
Provider context window (not max output)
Measured matrix and verified gateway observations only.
PROVIDER
RELEASE
2024-05-14
CONTEXT
1M tokens
STATUS
ACTIVE
Real operator evaluations, prompt robustness observations, and deployment notes for gemini-1.5-flash-001.
Tested gemini-1.5-flash-001 on high-concurrency tool loops. Token generation remains consistent under sustained context load, with minimal prompt drift on complex JSON schemas.
Evaluated gemini-1.5-flash-001 on multi-turn code synthesis. Code reasoning and diff application succeed on ~88% of test suites. Best paired with strict system prompt guardrails.
| Metric | |
|---|---|
| Provider | |
| Release | 2024-05-14 |
| Input / 1M | $0.07 |
| Output / 1M | $0.30 |
| Context | 1M tokens |
| Cadle Cap | 123 |
| Cap board | Cadle Language Cap 123 |
| mmlu | 70.5 |
| gsm8k | 82.4 |
| dtbench | 19.0 |
| otis-mock-aime-2024-2025 | 3.8 |
| math-level-5 | 25.1 |
| gpqa-diamond | 21.4 |
Scores may use different scales — check the Benchmarks tab for source links.
Evidence linked to this model — listing, hub, benchmarks, or live gateway prices.
API
Google listing