mistral 7B v0.3 bnb 4bit

Unsloth · unsloth/mistral-7b-v0-3-bnb-4bit

ProviderUnsloth
Familymistral
Typellm-chat
Statusactive
Released2024-05-22

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed60.5
BIG-Bench Hardunassessed45.2
GPQA Diamondunassessed29.2
GSM8Kunassessed34.5
HellaSwagunassessed83.0
IFEvalunassessed22.7
MATH-500unassessed3.0
MMLU: Abstract Algebraunassessed30.0
MMLU: Anatomyunassessed60.7
MMLU: Astronomyunassessed65.1
MMLU: Business Ethicsunassessed61.0
MMLU: Clinical Knowledgeunassessed68.3
MMLU: College Biologyunassessed69.4
MMLU: College Chemistryunassessed49.0
MMLU: College Computer Scienceunassessed52.0
MMLU: College Mathematicsunassessed37.0
MMLU: College Medicineunassessed63.0
MMLU: College Physicsunassessed31.4
MMLU: Computer Securityunassessed73.0
MMLU: Conceptual Physicsunassessed58.3
MMLU: Econometricsunassessed44.7
MMLU: Electrical Engineeringunassessed55.9
MMLU: Elementary Mathematicsunassessed40.2
MMLU: Formal Logicunassessed39.7
MMLU: Global Factsunassessed40.0
MMLU: High School Biologyunassessed76.1
MMLU: High School Chemistryunassessed54.2
MMLU: High School Computer Scienceunassessed65.0
MMLU: High School European Historyunassessed76.4
MMLU: High School Geographyunassessed77.3
MMLU: High School Government and Politicsunassessed87.6
MMLU: High School Macroeconomicsunassessed60.5
MMLU: High School Mathematicsunassessed35.9
MMLU: High School Microeconomicsunassessed63.9
MMLU: High School Physicsunassessed35.8
MMLU: High School Psychologyunassessed80.0
MMLU: High School Statisticsunassessed51.9
MMLU: High School US Historyunassessed81.4
MMLU: High School World Historyunassessed78.1
MMLU: Human Agingunassessed70.0
MMLU: Human Sexualityunassessed77.1
MMLU: International Lawunassessed81.0
MMLU: Jurisprudenceunassessed74.1
MMLU: Logical Fallaciesunassessed78.5
MMLU: Machine Learningunassessed53.6
MMLU: Managementunassessed81.6
MMLU: Marketingunassessed88.0
MMLU: Medical Geneticsunassessed70.0
MMLU: Miscellaneousunassessed79.8
MMLU: Moral Disputesunassessed70.2
MMLU: Moral Scenariosunassessed39.8
MMLU: Nutritionunassessed74.2
MMLU: Philosophyunassessed72.7
MMLU: Prehistoryunassessed68.8
MMLU-Prounassessed29.5
MMLU: Professional Accountingunassessed51.1
MMLU: Professional Lawunassessed46.2
MMLU: Professional Medicineunassessed68.8
MMLU: Professional Psychologyunassessed66.2
MMLU: Public Relationsunassessed64.5
MMLU: Security Studiesunassessed72.7
MMLU: Sociologyunassessed82.6
MMLU: US Foreign Policyunassessed88.0
MMLU: Virologyunassessed53.6
MMLU: World Religionsunassessed81.9
MuSRunassessed40.3
TruthfulQAunassessed41.8
WinoGrandeunassessed78.5

Data

This card as JSON · Edit on GitHub