Mistral: Mistral Small 3.1 24B — benchmark results

Provider: Mistral. Access: Open.

Unified ELO 1429 ± 23, rank #1072 of 1752 rated models, from 9 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AA-LCR19.7Score (self-reported)38.9
TextClass Benchmark1484.82Meta-Elo (self-reported)35.5
CritPt0Accuracy (self-reported)30.3
Defects4J22.5Defects4J Plausible @1 (self-reported)15.6
Vals AI MATH 50068.4Accuracy (%)9
Vals AI MGSM84.22Accuracy (%)8.2
Creative Writing v3856.2Elo score (self-reported)7.9
Polaris-Bench19.4Overall C (self-reported)7.1
EQ-Bench776.7Normalized Elo (self-reported)6.6

Interactive version: aibenchmarks.dev/model?slug=mistral-mistral-small-3-1-24b · How the rankings work · Data refreshed daily, snapshot 2026-07-16.