Yi 1.5 34B Chat

01.AI · 01-ai/yi-1-5-34b-chat

Provider01.AI
Familyyi
Typellm-chat
Statusactive
Released2024-05-10

Reported benchmark scores

These scores carry one collection date for the whole card (2026-04) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed70.5
BIG-Bench Hardunassessed48.2
GPQA Diamondunassessed36.5
GSM8Kunassessed71.6
HellaSwagunassessed86.0
IFEvalunassessed77.3
MATH-500unassessed58.5
MMLU: Abstract Algebraunassessed58.0
MMLU: Anatomyunassessed80.0
MMLU: Astronomyunassessed87.5
MMLU: Business Ethicsunassessed81.0
MMLU: Clinical Knowledgeunassessed77.4
MMLU: College Biologyunassessed82.6
MMLU: College Chemistryunassessed56.0
MMLU: College Computer Scienceunassessed69.0
MMLU: College Mathematicsunassessed51.0
MMLU: College Medicineunassessed75.1
MMLU: College Physicsunassessed52.0
MMLU: Computer Securityunassessed82.0
MMLU: Conceptual Physicsunassessed81.7
MMLU: Econometricsunassessed57.9
MMLU: Electrical Engineeringunassessed74.5
MMLU: Elementary Mathematicsunassessed75.4
MMLU: Formal Logicunassessed66.7
MMLU: Global Factsunassessed51.0
MMLU: High School Biologyunassessed88.4
MMLU: High School Chemistryunassessed66.5
MMLU: High School Computer Scienceunassessed90.0
MMLU: High School European Historyunassessed86.1
MMLU: High School Geographyunassessed88.4
MMLU: High School Government and Politicsunassessed95.9
MMLU: High School Macroeconomicsunassessed83.8
MMLU: High School Mathematicsunassessed55.6
MMLU: High School Microeconomicsunassessed87.8
MMLU: High School Physicsunassessed60.9
MMLU: High School Psychologyunassessed89.0
MMLU: High School Statisticsunassessed68.1
MMLU: High School US Historyunassessed90.7
MMLU: High School World Historyunassessed88.2
MMLU: Human Agingunassessed80.7
MMLU: Human Sexualityunassessed87.8
MMLU: International Lawunassessed87.6
MMLU: Jurisprudenceunassessed83.3
MMLU: Logical Fallaciesunassessed85.9
MMLU: Machine Learningunassessed63.4
MMLU: Managementunassessed88.3
MMLU: Marketingunassessed92.3
MMLU: Medical Geneticsunassessed84.0
MMLU: Miscellaneousunassessed89.9
MMLU: Moral Disputesunassessed81.2
MMLU: Moral Scenariosunassessed68.2
MMLU: Nutritionunassessed82.7
MMLU: Philosophyunassessed77.5
MMLU: Prehistoryunassessed85.2
MMLU-Prounassessed52.8
MMLU: Professional Accountingunassessed63.1
MMLU: Professional Lawunassessed57.0
MMLU: Professional Medicineunassessed81.2
MMLU: Professional Psychologyunassessed78.3
MMLU: Public Relationsunassessed72.7
MMLU: Security Studiesunassessed82.0
MMLU: Sociologyunassessed88.1
MMLU: US Foreign Policyunassessed86.0
MMLU: Virologyunassessed62.7
MMLU: World Religionsunassessed86.5
MuSRunassessed18.2
TruthfulQAunassessed62.2
WinoGrandeunassessed81.6

Data

This card as JSON · Edit on GitHub