Mixtral 8x7B v0.1

Mistral AI · mistral/mixtral-8x7b-v0-1

ProviderMistral AI
Familymistral
Typellm-chat
Statusactive
Released2023-12-01

Reported benchmark scores

These scores carry one collection date for the whole card (2026-04) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed66.4
BIG-Bench Hardunassessed36.8
GPQA Diamondunassessed27.2
GSM8Kunassessed57.6
HellaSwagunassessed86.5
IFEvalunassessed69.5
MATH-500unassessed40.1
MMLU: Abstract Algebraunassessed34.0
MMLU: Anatomyunassessed71.9
MMLU: Astronomyunassessed82.9
MMLU: Business Ethicsunassessed76.0
MMLU: Clinical Knowledgeunassessed78.5
MMLU: College Biologyunassessed86.8
MMLU: College Chemistryunassessed54.0
MMLU: College Computer Scienceunassessed63.0
MMLU: College Mathematicsunassessed46.0
MMLU: College Medicineunassessed69.9
MMLU: College Physicsunassessed46.1
MMLU: Computer Securityunassessed81.0
MMLU: Conceptual Physicsunassessed68.1
MMLU: Econometricsunassessed64.9
MMLU: Electrical Engineeringunassessed69.0
MMLU: Elementary Mathematicsunassessed48.1
MMLU: Formal Logicunassessed56.3
MMLU: Global Factsunassessed51.0
MMLU: High School Biologyunassessed84.2
MMLU: High School Chemistryunassessed63.5
MMLU: High School Computer Scienceunassessed72.0
MMLU: High School European Historyunassessed81.8
MMLU: High School Geographyunassessed86.4
MMLU: High School Government and Politicsunassessed93.8
MMLU: High School Macroeconomicsunassessed70.5
MMLU: High School Mathematicsunassessed38.5
MMLU: High School Microeconomicsunassessed78.6
MMLU: High School Physicsunassessed49.0
MMLU: High School Psychologyunassessed88.1
MMLU: High School Statisticsunassessed64.8
MMLU: High School US Historyunassessed84.8
MMLU: High School World Historyunassessed89.0
MMLU: Human Agingunassessed78.0
MMLU: Human Sexualityunassessed80.9
MMLU: International Lawunassessed87.6
MMLU: Jurisprudenceunassessed83.3
MMLU: Logical Fallaciesunassessed77.3
MMLU: Machine Learningunassessed53.6
MMLU: Managementunassessed88.3
MMLU: Marketingunassessed91.9
MMLU: Medical Geneticsunassessed78.0
MMLU: Miscellaneousunassessed87.5
MMLU: Moral Disputesunassessed79.8
MMLU: Moral Scenariosunassessed40.1
MMLU: Nutritionunassessed82.4
MMLU: Philosophyunassessed78.5
MMLU: Prehistoryunassessed84.0
MMLU-Prounassessed40.5
MMLU: Professional Accountingunassessed51.8
MMLU: Professional Lawunassessed53.2
MMLU: Professional Medicineunassessed81.2
MMLU: Professional Psychologyunassessed78.4
MMLU: Public Relationsunassessed70.0
MMLU: Security Studiesunassessed78.8
MMLU: Sociologyunassessed89.1
MMLU: US Foreign Policyunassessed92.0
MMLU: Virologyunassessed51.2
MMLU: World Religionsunassessed87.7
MuSRunassessed11.8
TruthfulQAunassessed46.8
WinoGrandeunassessed81.7

Data

This card as JSON · Edit on GitHub