Yi 9B

01.AI · 01-ai/yi-9b

Provider01.AI
Familyyi
Typellm-chat
Statusactive
Released2024-03-01

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed61.2
BIG-Bench Hardunassessed49.4
GPQA Diamondunassessed31.8
GSM8Kunassessed49.0
HellaSwagunassessed78.8
IFEvalunassessed27.1
MATH-500unassessed5.6
MMLU: Abstract Algebraunassessed34.0
MMLU: Anatomyunassessed57.8
MMLU: Astronomyunassessed75.7
MMLU: Business Ethicsunassessed80.0
MMLU: Clinical Knowledgeunassessed73.2
MMLU: College Biologyunassessed82.6
MMLU: College Chemistryunassessed54.0
MMLU: College Computer Scienceunassessed62.0
MMLU: College Mathematicsunassessed43.0
MMLU: College Medicineunassessed74.6
MMLU: College Physicsunassessed42.2
MMLU: Computer Securityunassessed82.0
MMLU: Conceptual Physicsunassessed71.9
MMLU: Econometricsunassessed52.6
MMLU: Electrical Engineeringunassessed72.4
MMLU: Elementary Mathematicsunassessed60.1
MMLU: Formal Logicunassessed58.7
MMLU: Global Factsunassessed33.0
MMLU: High School Biologyunassessed84.5
MMLU: High School Chemistryunassessed58.1
MMLU: High School Computer Scienceunassessed83.0
MMLU: High School European Historyunassessed78.2
MMLU: High School Geographyunassessed85.4
MMLU: High School Government and Politicsunassessed93.8
MMLU: High School Macroeconomicsunassessed75.9
MMLU: High School Mathematicsunassessed40.0
MMLU: High School Microeconomicsunassessed82.4
MMLU: High School Physicsunassessed41.1
MMLU: High School Psychologyunassessed86.8
MMLU: High School Statisticsunassessed68.5
MMLU: High School US Historyunassessed86.3
MMLU: High School World Historyunassessed81.9
MMLU: Human Agingunassessed74.4
MMLU: Human Sexualityunassessed78.6
MMLU: International Lawunassessed83.5
MMLU: Jurisprudenceunassessed79.6
MMLU: Logical Fallaciesunassessed76.1
MMLU: Machine Learningunassessed58.0
MMLU: Managementunassessed83.5
MMLU: Marketingunassessed91.0
MMLU: Medical Geneticsunassessed75.0
MMLU: Miscellaneousunassessed83.9
MMLU: Moral Disputesunassessed76.6
MMLU: Moral Scenariosunassessed40.0
MMLU: Nutritionunassessed75.5
MMLU: Philosophyunassessed77.5
MMLU: Prehistoryunassessed76.9
MMLU-Prounassessed35.7
MMLU: Professional Accountingunassessed56.4
MMLU: Professional Lawunassessed49.5
MMLU: Professional Medicineunassessed71.0
MMLU: Professional Psychologyunassessed70.4
MMLU: Public Relationsunassessed74.5
MMLU: Security Studiesunassessed75.9
MMLU: Sociologyunassessed86.1
MMLU: US Foreign Policyunassessed90.0
MMLU: Virologyunassessed51.2
MMLU: World Religionsunassessed83.0
MuSRunassessed40.5
TruthfulQAunassessed42.4
WinoGrandeunassessed77.5

Data

This card as JSON · Edit on GitHub