Qwen2 1.5B Instruct

Alibaba / Qwen Team · qwen/qwen2-1-5b-instruct

ProviderAlibaba / Qwen Team
Familyqwen
Typellm-chat
Statusactive
Released2024-06-03

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed44.3
BIG-Bench Hardunassessed38.5
GPQA Diamondunassessed26.2
GSM8Kunassessed55.8
HellaSwagunassessed66.7
IFEvalunassessed33.7
MATH-500unassessed7.2
MMLU: Abstract Algebraunassessed34.0
MMLU: Anatomyunassessed48.9
MMLU: Astronomyunassessed55.3
MMLU: Business Ethicsunassessed67.0
MMLU: Clinical Knowledgeunassessed60.0
MMLU: College Biologyunassessed56.2
MMLU: College Chemistryunassessed38.0
MMLU: College Computer Scienceunassessed51.0
MMLU: College Mathematicsunassessed32.0
MMLU: College Medicineunassessed49.1
MMLU: College Physicsunassessed40.2
MMLU: Computer Securityunassessed66.0
MMLU: Conceptual Physicsunassessed50.2
MMLU: Econometricsunassessed38.6
MMLU: Electrical Engineeringunassessed57.9
MMLU: Elementary Mathematicsunassessed42.3
MMLU: Formal Logicunassessed38.9
MMLU: Global Factsunassessed36.0
MMLU: High School Biologyunassessed64.2
MMLU: High School Chemistryunassessed49.3
MMLU: High School Computer Scienceunassessed56.0
MMLU: High School European Historyunassessed70.9
MMLU: High School Geographyunassessed73.7
MMLU: High School Government and Politicsunassessed78.8
MMLU: High School Macroeconomicsunassessed58.5
MMLU: High School Mathematicsunassessed35.9
MMLU: High School Microeconomicsunassessed62.2
MMLU: High School Physicsunassessed35.8
MMLU: High School Psychologyunassessed75.2
MMLU: High School Statisticsunassessed44.4
MMLU: High School US Historyunassessed64.7
MMLU: High School World Historyunassessed70.5
MMLU: Human Agingunassessed61.9
MMLU: Human Sexualityunassessed67.2
MMLU: International Lawunassessed74.4
MMLU: Jurisprudenceunassessed69.4
MMLU: Logical Fallaciesunassessed68.7
MMLU: Machine Learningunassessed42.0
MMLU: Managementunassessed83.5
MMLU: Marketingunassessed80.3
MMLU: Medical Geneticsunassessed62.0
MMLU: Miscellaneousunassessed72.0
MMLU: Moral Disputesunassessed62.7
MMLU: Moral Scenariosunassessed29.7
MMLU: Nutritionunassessed69.3
MMLU: Philosophyunassessed64.3
MMLU: Prehistoryunassessed59.0
MMLU-Prounassessed25.0
MMLU: Professional Accountingunassessed43.6
MMLU: Professional Lawunassessed42.8
MMLU: Professional Medicineunassessed50.4
MMLU: Professional Psychologyunassessed55.4
MMLU: Public Relationsunassessed60.0
MMLU: Security Studiesunassessed68.2
MMLU: Sociologyunassessed75.6
MMLU: US Foreign Policyunassessed79.0
MMLU: Virologyunassessed46.4
MMLU: World Religionsunassessed74.3
MuSRunassessed42.9
TruthfulQAunassessed45.9
WinoGrandeunassessed64.9

Data

This card as JSON · Edit on GitHub