Yi 1.5 34B

01.AI · 01-ai/yi-1-5-34b

Provider01.AI
Familyyi
Typellm-chat
Statusactive
Released2024-05-11

Reported benchmark scores

These scores carry one collection date for the whole card (2026-04) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed65.8
BIG-Bench Hardunassessed48.2
GPQA Diamondunassessed36.5
GSM8Kunassessed73.2
HellaSwagunassessed86.1
IFEvalunassessed77.3
MATH-500unassessed58.5
MMLU: Abstract Algebraunassessed55.0
MMLU: Anatomyunassessed75.6
MMLU: Astronomyunassessed88.2
MMLU: Business Ethicsunassessed80.0
MMLU: Clinical Knowledgeunassessed83.0
MMLU: College Biologyunassessed87.5
MMLU: College Chemistryunassessed57.0
MMLU: College Computer Scienceunassessed70.0
MMLU: College Mathematicsunassessed59.0
MMLU: College Medicineunassessed75.1
MMLU: College Physicsunassessed56.9
MMLU: Computer Securityunassessed86.0
MMLU: Conceptual Physicsunassessed83.8
MMLU: Econometricsunassessed64.9
MMLU: Electrical Engineeringunassessed78.6
MMLU: Elementary Mathematicsunassessed72.0
MMLU: Formal Logicunassessed67.5
MMLU: Global Factsunassessed55.0
MMLU: High School Biologyunassessed87.7
MMLU: High School Chemistryunassessed69.5
MMLU: High School Computer Scienceunassessed83.0
MMLU: High School European Historyunassessed87.3
MMLU: High School Geographyunassessed93.4
MMLU: High School Government and Politicsunassessed94.8
MMLU: High School Macroeconomicsunassessed83.1
MMLU: High School Mathematicsunassessed51.1
MMLU: High School Microeconomicsunassessed88.7
MMLU: High School Physicsunassessed55.6
MMLU: High School Psychologyunassessed91.4
MMLU: High School Statisticsunassessed72.7
MMLU: High School US Historyunassessed89.2
MMLU: High School World Historyunassessed90.7
MMLU: Human Agingunassessed81.2
MMLU: Human Sexualityunassessed87.8
MMLU: International Lawunassessed87.6
MMLU: Jurisprudenceunassessed85.2
MMLU: Logical Fallaciesunassessed87.1
MMLU: Machine Learningunassessed58.0
MMLU: Managementunassessed91.3
MMLU: Marketingunassessed94.9
MMLU: Medical Geneticsunassessed86.0
MMLU: Miscellaneousunassessed90.2
MMLU: Moral Disputesunassessed81.2
MMLU: Moral Scenariosunassessed64.7
MMLU: Nutritionunassessed84.3
MMLU: Philosophyunassessed81.4
MMLU: Prehistoryunassessed84.6
MMLU-Prounassessed52.8
MMLU: Professional Accountingunassessed62.1
MMLU: Professional Lawunassessed58.0
MMLU: Professional Medicineunassessed84.9
MMLU: Professional Psychologyunassessed80.9
MMLU: Public Relationsunassessed76.4
MMLU: Security Studiesunassessed82.4
MMLU: Sociologyunassessed87.1
MMLU: US Foreign Policyunassessed90.0
MMLU: Virologyunassessed56.6
MMLU: World Religionsunassessed88.9
MuSRunassessed18.2
TruthfulQAunassessed53.8
WinoGrandeunassessed84.1

Data

This card as JSON · Edit on GitHub