Benchmark avg
13.1
6 tracked scores
ActiveModel portfolio
DeepSeek R1 Distill Llama 8B
Tap a star to rate
DeepSeek · Released 2025-01-20 · v2025-01-20 · Open · Context 33K tokens
Cadle Score
—
Unranked · 79%
Benchmark average
—
Not enough benchmark results yet
Pricing
Unlisted
no list price
MODEL MATRIX · TRUTH CENTER CELLS
Overall
—
Intelligence
—
Coding
—
Reasoning
56.3
Language
21.5
Knowledge
12.1
Agentic
—
MMLU
12.1
GPQA
67.1
Math
22.0
LiveCodeBench
—
HumanEval
—
Reason
—
ARC-AGI
—
Coverage AVG
39.5
Pillar Coverage:4 / 7 Core Pillars (57%)
Cadle Cap ranks models with within-benchmark percentiles so ARC-AGI ~40 and MMLU ~90 never compete raw. Coverage AVG is an importance-weighted mean of filled expert cells only — blanks are skipped, not zeroed.
ANALYSIS · TRUTH CENTER
Hard benches (GPQA · ARC-AGI · LCB · Agentic) sit left — a mid-40 on ARC-AGI can still be frontier. Broader benches on the right are easier and often higher.
CADLE INSIGHTS
Only measured signals
Strongest signal
ifeval
Score 37.8
Context
33K
Provider context window (not max output)
DESCRIPTION + DETAILS
PROVIDER
DeepSeek
RELEASE
2025-01-20
CONTEXT
33K tokens
STATUS
ACTIVE
COMMUNITY REVIEWS
Community Reviews & Field Notes
Verified EngineersReal operator evaluations, prompt robustness observations, and deployment notes for DeepSeek R1 Distill Llama 8B.
4.5(2)
Leave a Field Observation
Rating:5 - Frontier benchmark
Role:
Tag topic:
Reviews are publicly visible to the engineering community.
Inference OperatorProduction Deployer Verified
Oct 31, 2026
Tested DeepSeek R1 Distill Llama 8B on high-concurrency tool loops. Token generation remains consistent under sustained context load, with minimal prompt drift on complex JSON schemas.
Autonomous Agent LeadEval Maintainer Verified
Oct 27, 2026
Evaluated DeepSeek R1 Distill Llama 8B on multi-turn code synthesis. Code reasoning and diff application succeed on ~88% of test suites. Best paired with strict system prompt guardrails.
MODEL COMPARISON
| Metric | |
|---|---|
| Provider | DeepSeek |
| Release | 2025-01-20 |
| Input / 1M | No data yet |
| Output / 1M | No data yet |
| Context | 33K tokens |
| Cadle Cap | 57 |
| Cap board | Unranked |
| mmlu-pro | 12.1 |
| musr | 0.5 |
| gpqa-diamond | 0.7 |
| math-level-5 | 22.0 |
| bbh | 5.3 |
| ifeval | 37.8 |
DATA PROVENANCE
Scores may use different scales — check the Benchmarks tab for source links.
- Supabase models
- Cadle public observations
SOURCE TRACKING
Evidence linked to this model — listing, hub, benchmarks, or live gateway prices.
API
DeepSeek listing
MEASURED CELLS
Same Truth Center numbers as the datasheet above. Accuracy, reliability, safety, and cost scores are not invented.
MMLU12.1
GPQA67.1
Math22