Yi 1.5 9B

01.AI · 01-ai/yi-1-5-9b

Provider01.AI
Familyyi
Typellm-chat
Statusactive
Released2024-05-11

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed61.9
BIG-Bench Hardunassessed51.4
GPQA Diamondunassessed37.9
GSM8Kunassessed62.7
HellaSwagunassessed80.4
IFEvalunassessed29.4
MATH-500unassessed11.4
MMLU: Abstract Algebraunassessed44.0
MMLU: Anatomyunassessed66.7
MMLU: Astronomyunassessed75.7
MMLU: Business Ethicsunassessed78.0
MMLU: Clinical Knowledgeunassessed68.3
MMLU: College Biologyunassessed79.2
MMLU: College Chemistryunassessed53.0
MMLU: College Computer Scienceunassessed58.0
MMLU: College Mathematicsunassessed53.0
MMLU: College Medicineunassessed69.9
MMLU: College Physicsunassessed47.1
MMLU: Computer Securityunassessed85.0
MMLU: Conceptual Physicsunassessed73.6
MMLU: Econometricsunassessed63.2
MMLU: Electrical Engineeringunassessed69.0
MMLU: Elementary Mathematicsunassessed63.2
MMLU: Formal Logicunassessed53.2
MMLU: Global Factsunassessed40.0
MMLU: High School Biologyunassessed84.5
MMLU: High School Chemistryunassessed63.5
MMLU: High School Computer Scienceunassessed83.0
MMLU: High School European Historyunassessed83.0
MMLU: High School Geographyunassessed84.8
MMLU: High School Government and Politicsunassessed90.2
MMLU: High School Macroeconomicsunassessed75.4
MMLU: High School Mathematicsunassessed43.7
MMLU: High School Microeconomicsunassessed86.1
MMLU: High School Physicsunassessed47.7
MMLU: High School Psychologyunassessed85.9
MMLU: High School Statisticsunassessed65.3
MMLU: High School US Historyunassessed84.3
MMLU: High School World Historyunassessed84.8
MMLU: Human Agingunassessed74.4
MMLU: Human Sexualityunassessed77.9
MMLU: International Lawunassessed82.6
MMLU: Jurisprudenceunassessed74.1
MMLU: Logical Fallaciesunassessed78.5
MMLU: Machine Learningunassessed50.0
MMLU: Managementunassessed80.6
MMLU: Marketingunassessed89.7
MMLU: Medical Geneticsunassessed77.0
MMLU: Miscellaneousunassessed83.0
MMLU: Moral Disputesunassessed74.6
MMLU: Moral Scenariosunassessed48.6
MMLU: Nutritionunassessed78.4
MMLU: Philosophyunassessed75.6
MMLU: Prehistoryunassessed75.3
MMLU-Prounassessed39.2
MMLU: Professional Accountingunassessed56.7
MMLU: Professional Lawunassessed50.3
MMLU: Professional Medicineunassessed70.2
MMLU: Professional Psychologyunassessed73.9
MMLU: Public Relationsunassessed70.9
MMLU: Security Studiesunassessed75.5
MMLU: Sociologyunassessed84.1
MMLU: US Foreign Policyunassessed91.0
MMLU: Virologyunassessed53.6
MMLU: World Religionsunassessed83.0
MuSRunassessed43.3
TruthfulQAunassessed46.7
WinoGrandeunassessed78.0

Data

This card as JSON · Edit on GitHub