Yi 34B Chat

01.AI · 01-ai/yi-34b-chat

Provider01.AI
Familyyi
Typellm-chat
Statusactive
Released2023-11-22

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed65.4
BIG-Bench Hardunassessed55.6
GPQA Diamondunassessed33.8
GSM8Kunassessed31.9
HellaSwagunassessed84.2
IFEvalunassessed47.0
MATH-500unassessed6.3
MMLU: Abstract Algebraunassessed45.0
MMLU: Anatomyunassessed71.1
MMLU: Astronomyunassessed85.5
MMLU: Business Ethicsunassessed79.0
MMLU: Clinical Knowledgeunassessed79.2
MMLU: College Biologyunassessed84.7
MMLU: College Chemistryunassessed53.0
MMLU: College Computer Scienceunassessed59.0
MMLU: College Mathematicsunassessed34.0
MMLU: College Medicineunassessed69.9
MMLU: College Physicsunassessed46.1
MMLU: Computer Securityunassessed82.0
MMLU: Conceptual Physicsunassessed76.6
MMLU: Econometricsunassessed55.3
MMLU: Electrical Engineeringunassessed80.0
MMLU: Elementary Mathematicsunassessed63.5
MMLU: Formal Logicunassessed54.0
MMLU: Global Factsunassessed56.0
MMLU: High School Biologyunassessed87.1
MMLU: High School Chemistryunassessed62.1
MMLU: High School Computer Scienceunassessed81.0
MMLU: High School European Historyunassessed85.5
MMLU: High School Geographyunassessed89.9
MMLU: High School Government and Politicsunassessed95.3
MMLU: High School Macroeconomicsunassessed78.5
MMLU: High School Mathematicsunassessed35.6
MMLU: High School Microeconomicsunassessed83.6
MMLU: High School Physicsunassessed50.3
MMLU: High School Psychologyunassessed90.8
MMLU: High School Statisticsunassessed63.4
MMLU: High School US Historyunassessed90.7
MMLU: High School World Historyunassessed90.3
MMLU: Human Agingunassessed81.2
MMLU: Human Sexualityunassessed89.3
MMLU: International Lawunassessed89.3
MMLU: Jurisprudenceunassessed88.9
MMLU: Logical Fallaciesunassessed85.3
MMLU: Machine Learningunassessed61.6
MMLU: Managementunassessed87.4
MMLU: Marketingunassessed91.5
MMLU: Medical Geneticsunassessed87.0
MMLU: Miscellaneousunassessed89.9
MMLU: Moral Disputesunassessed80.9
MMLU: Moral Scenariosunassessed70.2
MMLU: Nutritionunassessed83.0
MMLU: Philosophyunassessed81.0
MMLU: Prehistoryunassessed87.0
MMLU-Prounassessed40.9
MMLU: Professional Accountingunassessed61.7
MMLU: Professional Lawunassessed55.0
MMLU: Professional Medicineunassessed78.3
MMLU: Professional Psychologyunassessed82.7
MMLU: Public Relationsunassessed72.7
MMLU: Security Studiesunassessed83.7
MMLU: Sociologyunassessed88.6
MMLU: US Foreign Policyunassessed89.0
MMLU: Virologyunassessed58.4
MMLU: World Religionsunassessed87.7
MuSRunassessed39.8
TruthfulQAunassessed55.4
WinoGrandeunassessed80.1

Data

This card as JSON · Edit on GitHub