Benchmark avg
27.3
6 tracked scores
ActiveModel portfolio
deepseek-llm-67b-chat
Tap a star to rate
DeepSeek · Released 2023-11-29 · v2023-11-29 · Open
Cadle Score
—
Unranked · 50%
Benchmark average
—
Not enough benchmark results yet
Pricing
Unlisted
no list price
MODEL MATRIX · TRUTH CENTER CELLS
Overall
—
Intelligence
—
Coding
—
Reasoning
16.4
Language
44.5
Knowledge
32.7
Agentic
—
MMLU
32.7
GPQA
8.8
Math
9.3
LiveCodeBench
—
HumanEval
—
Reason
—
ARC-AGI
—
Coverage AVG
14.4
Pillar Coverage:4 / 7 Core Pillars (57%)
Cadle Cap ranks models with within-benchmark percentiles so ARC-AGI ~40 and MMLU ~90 never compete raw. Coverage AVG is an importance-weighted mean of filled expert cells only — blanks are skipped, not zeroed.
ANALYSIS · TRUTH CENTER
Hard benches (GPQA · ARC-AGI · LCB · Agentic) sit left — a mid-40 on ARC-AGI can still be frontier. Broader benches on the right are easier and often higher.
CADLE INSIGHTS
Only measured signals
Strongest signal
ifeval
Score 55.9
Blended $/1M
Unlisted
No published list price
DESCRIPTION + DETAILS
PROVIDER
DeepSeek
RELEASE
2023-11-29
STATUS
ACTIVE
COMMUNITY REVIEWS
Community Reviews & Field Notes
Verified EngineersReal operator evaluations, prompt robustness observations, and deployment notes for deepseek-llm-67b-chat.
4.5(2)
Leave a Field Observation
Rating:5 - Frontier benchmark
Role:
Tag topic:
Reviews are publicly visible to the engineering community.
Inference OperatorProduction Deployer Verified
Nov 1, 2026
Tested deepseek-llm-67b-chat on high-concurrency tool loops. Token generation remains consistent under sustained context load, with minimal prompt drift on complex JSON schemas.
Autonomous Agent LeadEval Maintainer Verified
Oct 28, 2026
Evaluated deepseek-llm-67b-chat on multi-turn code synthesis. Code reasoning and diff application succeed on ~88% of test suites. Best paired with strict system prompt guardrails.
MODEL COMPARISON
| Metric | |
|---|---|
| Provider | DeepSeek |
| Release | 2023-11-29 |
| Input / 1M | No data yet |
| Output / 1M | No data yet |
| Context | No data yet |
| Cadle Cap | 61 |
| Cap board | Unranked |
| mmlu-pro | 32.7 |
| musr | 23.9 |
| gpqa-diamond | 8.8 |
| math-level-5 | 9.3 |
| bbh | 33.2 |
| ifeval | 55.9 |
DATA PROVENANCE
Scores may use different scales — check the Benchmarks tab for source links.
- Supabase models
- Cadle public observations
MEASURED CELLS
Same Truth Center numbers as the datasheet above. Accuracy, reliability, safety, and cost scores are not invented.
MMLU32.7
GPQA8.8
Math9.3