Yi 1.5 9B Chat

01.AI · 01-ai/yi-1-5-9b-chat

Provider01.AI
Familyyi
Typellm-chat
Statusactive
Released2024-05-10

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed63.7
BIG-Bench Hardunassessed55.6
GPQA Diamondunassessed33.5
GSM8Kunassessed71.9
HellaSwagunassessed80.9
IFEvalunassessed60.5
MATH-500unassessed22.6
MMLU: Abstract Algebraunassessed46.0
MMLU: Anatomyunassessed63.7
MMLU: Astronomyunassessed72.4
MMLU: Business Ethicsunassessed74.0
MMLU: Clinical Knowledgeunassessed72.8
MMLU: College Biologyunassessed79.2
MMLU: College Chemistryunassessed59.0
MMLU: College Computer Scienceunassessed66.0
MMLU: College Mathematicsunassessed48.0
MMLU: College Medicineunassessed71.1
MMLU: College Physicsunassessed46.1
MMLU: Computer Securityunassessed77.0
MMLU: Conceptual Physicsunassessed72.3
MMLU: Econometricsunassessed58.8
MMLU: Electrical Engineeringunassessed69.7
MMLU: Elementary Mathematicsunassessed64.0
MMLU: Formal Logicunassessed57.9
MMLU: Global Factsunassessed45.0
MMLU: High School Biologyunassessed83.5
MMLU: High School Chemistryunassessed66.5
MMLU: High School Computer Scienceunassessed87.0
MMLU: High School European Historyunassessed84.2
MMLU: High School Geographyunassessed85.9
MMLU: High School Government and Politicsunassessed90.2
MMLU: High School Macroeconomicsunassessed77.9
MMLU: High School Mathematicsunassessed47.0
MMLU: High School Microeconomicsunassessed87.0
MMLU: High School Physicsunassessed45.7
MMLU: High School Psychologyunassessed86.4
MMLU: High School Statisticsunassessed68.5
MMLU: High School US Historyunassessed84.8
MMLU: High School World Historyunassessed82.7
MMLU: Human Agingunassessed72.2
MMLU: Human Sexualityunassessed74.8
MMLU: International Lawunassessed83.5
MMLU: Jurisprudenceunassessed75.0
MMLU: Logical Fallaciesunassessed80.4
MMLU: Machine Learningunassessed53.6
MMLU: Managementunassessed86.4
MMLU: Marketingunassessed91.9
MMLU: Medical Geneticsunassessed80.0
MMLU: Miscellaneousunassessed83.4
MMLU: Moral Disputesunassessed73.7
MMLU: Moral Scenariosunassessed55.0
MMLU: Nutritionunassessed74.5
MMLU: Philosophyunassessed73.6
MMLU: Prehistoryunassessed73.1
MMLU-Prounassessed39.8
MMLU: Professional Accountingunassessed57.8
MMLU: Professional Lawunassessed48.0
MMLU: Professional Medicineunassessed67.6
MMLU: Professional Psychologyunassessed69.6
MMLU: Public Relationsunassessed69.1
MMLU: Security Studiesunassessed73.1
MMLU: Sociologyunassessed81.6
MMLU: US Foreign Policyunassessed91.0
MMLU: Virologyunassessed56.0
MMLU: World Religionsunassessed82.5
MuSRunassessed42.6
TruthfulQAunassessed52.7
WinoGrandeunassessed77.2

Data

This card as JSON · Edit on GitHub