SPEED · COST · QUALITY
Measured matrix / AA / gateway rows only.
- AA / Intel index
- 6.1
Mistral · Open weightsDeepHermes 3 - Mistral 24B Preview (Non-reasoning)
Active
Model portfolio
DeepHermes 3 - Mistral 24B Preview (Non-reasoning)
Tap a star to rate
Mistral · Released 2025-03-13 · v2025-03-13 · Open
Language Cap
No data yet
language · unranked
Benchmark average
41.1
Not enough benchmark results yet
Pricing
Unlisted
no list price
CADLE CAP vs MODEL MATRIX
Cadle Cap ranks models on every published score we have for them — harder benchmarks weigh more. Missing tests are skipped, not zeroed. It answers who is stronger than whom in today's pool.
Model Matrix is the datasheet: Overall, Intelligence, Coding, Agentic, MMLU, GPQA, Math, LiveCodeBench, HumanEval, Reason, ARC-AGI. A dash means unmeasured. AVG is an importance-weighted mean of that model's filled cells only.
MODEL MATRIX · TRUTH CENTER CELLS
Overall
No data yet
Intelligence
6.1
Coding
No data yet
Agentic
No data yet
MMLU
58.0
GPQA
38.2
Math
59.5
LiveCodeBench
19.5
HumanEval
No data yet
Reason
No data yet
ARC-AGI
No data yet
Coverage AVG
41.1
Cadle Cap ranks models with within-benchmark percentiles so ARC-AGI ~40 and MMLU ~90 never compete raw. Coverage AVG is an importance-weighted mean of filled expert cells only — blanks are skipped, not zeroed.
ANALYSIS · TRUTH CENTER
Hard benches (GPQA · ARC-AGI · LCB · Agentic) sit left — a mid-40 on ARC-AGI can still be frontier. Broader benches on the right are easier and often higher.
NOT RANKED YET
We only rank a model once it has enough published benchmark results to compare fairly. Everything below is what we do know: pricing, news and any scores that have been published.
DESCRIPTION + DETAILS
PROVIDER
Mistral
RELEASE
2025-03-13
STATUS
ACTIVE
COMMUNITY REVIEWS
OPERATOR NOTES
Quality, latency, cost, and failure modes — not marketing copy.
No reviews yet
WRITE A REVIEW
Tap a star to rate
Stored on this device · synced when signed in
No operator notes yet
First review sets the tone for how teams evaluate DeepHermes 3 - Mistral 24B Preview (Non-reasoning).
MODEL COMPARISON
| Metric | |
|---|---|
| Provider | Mistral |
| Release | 2025-03-13 |
| Input / 1M | No data yet |
| Output / 1M | No data yet |
| Context | No data yet |
| Cadle Cap | 54 |
| Cap board | Unranked |
DATA PROVENANCE
Scores may use different scales — check the Benchmarks tab for source links.
- Supabase models
- Cadle public observations
MEASURED CELLS
Same Truth Center numbers as the datasheet above. Accuracy, reliability, safety, and cost scores are not invented.
AA IQ6.1
MMLU58
GPQA38.2
Math59.5
LiveCodeBench19.5