Yi 1.5 9B Chat 16K

01.AI · 01-ai/yi-1-5-9b-chat-16k

Provider01.AI
Familyyi
Typellm-chat
Statusactive
Released2024-05-15

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed64.3
BIG-Bench Hardunassessed51.5
GPQA Diamondunassessed30.9
GSM8Kunassessed59.7
HellaSwagunassessed80.9
IFEvalunassessed42.1
MATH-500unassessed17.8
MMLU: Abstract Algebraunassessed46.0
MMLU: Anatomyunassessed68.1
MMLU: Astronomyunassessed74.3
MMLU: Business Ethicsunassessed76.0
MMLU: Clinical Knowledgeunassessed72.5
MMLU: College Biologyunassessed78.5
MMLU: College Chemistryunassessed54.0
MMLU: College Computer Scienceunassessed62.0
MMLU: College Mathematicsunassessed47.0
MMLU: College Medicineunassessed69.4
MMLU: College Physicsunassessed47.1
MMLU: Computer Securityunassessed77.0
MMLU: Conceptual Physicsunassessed71.1
MMLU: Econometricsunassessed59.6
MMLU: Electrical Engineeringunassessed66.2
MMLU: Elementary Mathematicsunassessed64.3
MMLU: Formal Logicunassessed61.1
MMLU: Global Factsunassessed45.0
MMLU: High School Biologyunassessed84.5
MMLU: High School Chemistryunassessed61.1
MMLU: High School Computer Scienceunassessed87.0
MMLU: High School European Historyunassessed83.6
MMLU: High School Geographyunassessed83.3
MMLU: High School Government and Politicsunassessed89.1
MMLU: High School Macroeconomicsunassessed76.2
MMLU: High School Mathematicsunassessed45.6
MMLU: High School Microeconomicsunassessed84.5
MMLU: High School Physicsunassessed51.0
MMLU: High School Psychologyunassessed85.7
MMLU: High School Statisticsunassessed65.3
MMLU: High School US Historyunassessed86.8
MMLU: High School World Historyunassessed84.8
MMLU: Human Agingunassessed71.7
MMLU: Human Sexualityunassessed74.8
MMLU: International Lawunassessed80.2
MMLU: Jurisprudenceunassessed77.8
MMLU: Logical Fallaciesunassessed82.2
MMLU: Machine Learningunassessed51.8
MMLU: Managementunassessed76.7
MMLU: Marketingunassessed91.5
MMLU: Medical Geneticsunassessed80.0
MMLU: Miscellaneousunassessed84.2
MMLU: Moral Disputesunassessed72.3
MMLU: Moral Scenariosunassessed54.6
MMLU: Nutritionunassessed77.5
MMLU: Philosophyunassessed75.9
MMLU: Prehistoryunassessed74.1
MMLU-Prounassessed39.9
MMLU: Professional Accountingunassessed57.8
MMLU: Professional Lawunassessed50.1
MMLU: Professional Medicineunassessed68.0
MMLU: Professional Psychologyunassessed70.8
MMLU: Public Relationsunassessed72.7
MMLU: Security Studiesunassessed77.1
MMLU: Sociologyunassessed81.1
MMLU: US Foreign Policyunassessed93.0
MMLU: Virologyunassessed57.2
MMLU: World Religionsunassessed84.2
MuSRunassessed41.0
TruthfulQAunassessed51.0
WinoGrandeunassessed75.0

Data

This card as JSON · Edit on GitHub