Yi 1.5 9B 32K

01.AI · 01-ai/yi-1-5-9b-32k

Provider01.AI
Familyyi
Typellm-chat
Statusactive
Released2024-05-15

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed61.1
BIG-Bench Hardunassessed49.6
GPQA Diamondunassessed35.9
GSM8Kunassessed0.0
HellaSwagunassessed79.8
IFEvalunassessed23.0
MATH-500unassessed10.8
MMLU: Abstract Algebraunassessed48.0
MMLU: Anatomyunassessed65.9
MMLU: Astronomyunassessed77.0
MMLU: Business Ethicsunassessed75.0
MMLU: Clinical Knowledgeunassessed71.7
MMLU: College Biologyunassessed81.9
MMLU: College Chemistryunassessed49.0
MMLU: College Computer Scienceunassessed60.0
MMLU: College Mathematicsunassessed53.0
MMLU: College Medicineunassessed70.5
MMLU: College Physicsunassessed47.1
MMLU: Computer Securityunassessed84.0
MMLU: Conceptual Physicsunassessed71.9
MMLU: Econometricsunassessed63.2
MMLU: Electrical Engineeringunassessed71.0
MMLU: Elementary Mathematicsunassessed60.3
MMLU: Formal Logicunassessed57.1
MMLU: Global Factsunassessed43.0
MMLU: High School Biologyunassessed84.2
MMLU: High School Chemistryunassessed63.5
MMLU: High School Computer Scienceunassessed82.0
MMLU: High School European Historyunassessed82.4
MMLU: High School Geographyunassessed84.8
MMLU: High School Government and Politicsunassessed91.2
MMLU: High School Macroeconomicsunassessed73.6
MMLU: High School Mathematicsunassessed43.0
MMLU: High School Microeconomicsunassessed82.8
MMLU: High School Physicsunassessed46.4
MMLU: High School Psychologyunassessed86.4
MMLU: High School Statisticsunassessed66.2
MMLU: High School US Historyunassessed84.3
MMLU: High School World Historyunassessed84.4
MMLU: Human Agingunassessed74.4
MMLU: Human Sexualityunassessed80.2
MMLU: International Lawunassessed81.0
MMLU: Jurisprudenceunassessed80.6
MMLU: Logical Fallaciesunassessed74.2
MMLU: Machine Learningunassessed50.9
MMLU: Managementunassessed81.6
MMLU: Marketingunassessed89.7
MMLU: Medical Geneticsunassessed80.0
MMLU: Miscellaneousunassessed84.4
MMLU: Moral Disputesunassessed75.7
MMLU: Moral Scenariosunassessed45.8
MMLU: Nutritionunassessed78.1
MMLU: Philosophyunassessed76.8
MMLU: Prehistoryunassessed74.4
MMLU-Prounassessed37.6
MMLU: Professional Accountingunassessed56.7
MMLU: Professional Lawunassessed50.7
MMLU: Professional Medicineunassessed69.5
MMLU: Professional Psychologyunassessed71.7
MMLU: Public Relationsunassessed73.6
MMLU: Security Studiesunassessed75.9
MMLU: Sociologyunassessed83.6
MMLU: US Foreign Policyunassessed93.0
MMLU: Virologyunassessed54.2
MMLU: World Religionsunassessed83.6
MuSRunassessed41.9
TruthfulQAunassessed42.5
WinoGrandeunassessed76.9

Data

This card as JSON · Edit on GitHub