Qwen2 0.5B Instruct

Alibaba / Qwen Team · qwen/qwen2-0-5b-instruct

ProviderAlibaba / Qwen Team
Familyqwen
Typellm-chat
Statusactive
Released2024-06-03

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed31.9
BIG-Bench Hardunassessed31.7
GPQA Diamondunassessed24.7
GSM8Kunassessed35.7
HellaSwagunassessed48.7
IFEvalunassessed22.5
MATH-500unassessed2.9
MMLU: Abstract Algebraunassessed34.0
MMLU: Anatomyunassessed43.0
MMLU: Astronomyunassessed41.4
MMLU: Business Ethicsunassessed43.0
MMLU: Clinical Knowledgeunassessed50.2
MMLU: College Biologyunassessed39.6
MMLU: College Chemistryunassessed28.0
MMLU: College Computer Scienceunassessed37.0
MMLU: College Mathematicsunassessed31.0
MMLU: College Medicineunassessed48.0
MMLU: College Physicsunassessed24.5
MMLU: Computer Securityunassessed50.0
MMLU: Conceptual Physicsunassessed37.0
MMLU: Econometricsunassessed32.5
MMLU: Electrical Engineeringunassessed47.6
MMLU: Elementary Mathematicsunassessed35.2
MMLU: Formal Logicunassessed33.3
MMLU: Global Factsunassessed36.0
MMLU: High School Biologyunassessed48.7
MMLU: High School Chemistryunassessed42.4
MMLU: High School Computer Scienceunassessed47.0
MMLU: High School European Historyunassessed57.6
MMLU: High School Geographyunassessed50.5
MMLU: High School Government and Politicsunassessed56.0
MMLU: High School Macroeconomicsunassessed45.9
MMLU: High School Mathematicsunassessed33.7
MMLU: High School Microeconomicsunassessed47.5
MMLU: High School Physicsunassessed27.8
MMLU: High School Psychologyunassessed56.5
MMLU: High School Statisticsunassessed38.9
MMLU: High School US Historyunassessed53.9
MMLU: High School World Historyunassessed59.1
MMLU: Human Agingunassessed43.0
MMLU: Human Sexualityunassessed48.1
MMLU: International Lawunassessed68.6
MMLU: Jurisprudenceunassessed59.3
MMLU: Logical Fallaciesunassessed47.9
MMLU: Machine Learningunassessed25.9
MMLU: Managementunassessed63.1
MMLU: Marketingunassessed68.4
MMLU: Medical Geneticsunassessed43.0
MMLU: Miscellaneousunassessed52.1
MMLU: Moral Disputesunassessed51.2
MMLU: Moral Scenariosunassessed25.6
MMLU: Nutritionunassessed51.6
MMLU: Philosophyunassessed50.5
MMLU: Prehistoryunassessed43.8
MMLU-Prounassessed15.3
MMLU: Professional Accountingunassessed37.2
MMLU: Professional Lawunassessed36.2
MMLU: Professional Medicineunassessed44.9
MMLU: Professional Psychologyunassessed41.3
MMLU: Public Relationsunassessed50.0
MMLU: Security Studiesunassessed54.3
MMLU: Sociologyunassessed61.2
MMLU: US Foreign Policyunassessed65.0
MMLU: Virologyunassessed37.3
MMLU: World Religionsunassessed48.5
MuSRunassessed33.5
TruthfulQAunassessed39.8
WinoGrandeunassessed55.8

Data

This card as JSON · Edit on GitHub