vicuna-7B-v1.5-16k — benchmark results

Provider: LMSYS. Access: Open.

Unified ELO 1209 ± 21, rank #1627 of 1719 rated models, from 82 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - Econometrics39.47Accuracy (%)91.4
MMLU-by-task - Machine Learning39.29Accuracy (%)79
MMLU-by-task - TruthfulQA MC250.35Accuracy (%)77.7
MMLU-by-task - Business Ethics55Accuracy (%)74.6
MMLU-by-task - TruthfulQA MC133.41Accuracy (%)72.8
MMLU-by-task - Medical Genetics58Accuracy (%)71.8
MMLU-by-task - Virology45.18Accuracy (%)70.2
MMLU-by-task - Professional Accounting39.72Accuracy (%)68.3
MMLU-by-task - Conceptual Physics42.98Accuracy (%)68
MMLU-by-task - Human Aging60.99Accuracy (%)65.5
MMLU-by-task - Security Studies59.18Accuracy (%)64.7
MMLU-by-task - Nutrition56.21Accuracy (%)64.2

Interactive version: aibenchmarks.dev/model?slug=vicuna-7b-v1-5-16k · How the rankings work · Data refreshed daily, snapshot 2026-07-09.