Yi 34B 200K

01.AI · 01-ai/yi-34b-200k

Provider01.AI
Familyyi
Typellm-chat
Statusactive
Released2023-11-06

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed65.8
BIG-Bench Hardunassessed54.4
GPQA Diamondunassessed35.7
GSM8Kunassessed34.9
HellaSwagunassessed82.1
IFEvalunassessed15.4
MATH-500unassessed5.7
MMLU: Abstract Algebraunassessed42.0
MMLU: Anatomyunassessed73.3
MMLU: Astronomyunassessed89.5
MMLU: Business Ethicsunassessed78.0
MMLU: Clinical Knowledgeunassessed81.1
MMLU: College Biologyunassessed88.2
MMLU: College Chemistryunassessed47.0
MMLU: College Computer Scienceunassessed63.0
MMLU: College Mathematicsunassessed40.0
MMLU: College Medicineunassessed71.1
MMLU: College Physicsunassessed54.9
MMLU: Computer Securityunassessed80.0
MMLU: Conceptual Physicsunassessed77.4
MMLU: Econometricsunassessed56.1
MMLU: Electrical Engineeringunassessed77.2
MMLU: Elementary Mathematicsunassessed64.6
MMLU: Formal Logicunassessed51.6
MMLU: Global Factsunassessed57.0
MMLU: High School Biologyunassessed89.7
MMLU: High School Chemistryunassessed65.0
MMLU: High School Computer Scienceunassessed82.0
MMLU: High School European Historyunassessed84.8
MMLU: High School Geographyunassessed92.9
MMLU: High School Government and Politicsunassessed97.4
MMLU: High School Macroeconomicsunassessed78.2
MMLU: High School Mathematicsunassessed38.1
MMLU: High School Microeconomicsunassessed84.0
MMLU: High School Physicsunassessed46.4
MMLU: High School Psychologyunassessed92.1
MMLU: High School Statisticsunassessed67.1
MMLU: High School US Historyunassessed90.7
MMLU: High School World Historyunassessed90.7
MMLU: Human Agingunassessed79.4
MMLU: Human Sexualityunassessed86.3
MMLU: International Lawunassessed91.7
MMLU: Jurisprudenceunassessed88.9
MMLU: Logical Fallaciesunassessed88.3
MMLU: Machine Learningunassessed58.0
MMLU: Managementunassessed89.3
MMLU: Marketingunassessed94.0
MMLU: Medical Geneticsunassessed88.0
MMLU: Miscellaneousunassessed90.3
MMLU: Moral Disputesunassessed80.3
MMLU: Moral Scenariosunassessed67.6
MMLU: Nutritionunassessed84.6
MMLU: Philosophyunassessed82.0
MMLU: Prehistoryunassessed83.6
MMLU-Prounassessed45.3
MMLU: Professional Accountingunassessed61.3
MMLU: Professional Lawunassessed59.1
MMLU: Professional Medicineunassessed80.9
MMLU: Professional Psychologyunassessed82.0
MMLU: Public Relationsunassessed72.7
MMLU: Security Studiesunassessed82.0
MMLU: Sociologyunassessed88.1
MMLU: US Foreign Policyunassessed92.0
MMLU: Virologyunassessed57.2
MMLU: World Religionsunassessed87.7
MuSRunassessed38.2
TruthfulQAunassessed42.6
WinoGrandeunassessed82.9

Data

This card as JSON · Edit on GitHub