Yi 1.5 34B 32K

01.AI · 01-ai/yi-1-5-34b-32k

Provider01.AI
Familyyi
Typellm-chat
Statusactive
Released2024-05-15

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed64.4
BIG-Bench Hardunassessed60.2
GPQA Diamondunassessed36.3
GSM8Kunassessed0.0
HellaSwagunassessed85.5
IFEvalunassessed31.2
MATH-500unassessed15.4
MMLU: Abstract Algebraunassessed56.0
MMLU: Anatomyunassessed75.6
MMLU: Astronomyunassessed89.5
MMLU: Business Ethicsunassessed82.0
MMLU: Clinical Knowledgeunassessed82.6
MMLU: College Biologyunassessed86.1
MMLU: College Chemistryunassessed52.0
MMLU: College Computer Scienceunassessed72.0
MMLU: College Mathematicsunassessed54.0
MMLU: College Medicineunassessed74.6
MMLU: College Physicsunassessed59.8
MMLU: Computer Securityunassessed86.0
MMLU: Conceptual Physicsunassessed84.7
MMLU: Econometricsunassessed63.2
MMLU: Electrical Engineeringunassessed80.7
MMLU: Elementary Mathematicsunassessed74.3
MMLU: Formal Logicunassessed62.7
MMLU: Global Factsunassessed54.0
MMLU: High School Biologyunassessed89.7
MMLU: High School Chemistryunassessed70.9
MMLU: High School Computer Scienceunassessed84.0
MMLU: High School European Historyunassessed88.5
MMLU: High School Geographyunassessed91.9
MMLU: High School Government and Politicsunassessed94.8
MMLU: High School Macroeconomicsunassessed83.6
MMLU: High School Mathematicsunassessed51.9
MMLU: High School Microeconomicsunassessed88.7
MMLU: High School Physicsunassessed54.3
MMLU: High School Psychologyunassessed91.0
MMLU: High School Statisticsunassessed71.3
MMLU: High School US Historyunassessed89.2
MMLU: High School World Historyunassessed89.0
MMLU: Human Agingunassessed82.5
MMLU: Human Sexualityunassessed88.5
MMLU: International Lawunassessed88.4
MMLU: Jurisprudenceunassessed88.9
MMLU: Logical Fallaciesunassessed86.5
MMLU: Machine Learningunassessed58.9
MMLU: Managementunassessed86.4
MMLU: Marketingunassessed95.3
MMLU: Medical Geneticsunassessed87.0
MMLU: Miscellaneousunassessed90.5
MMLU: Moral Disputesunassessed82.1
MMLU: Moral Scenariosunassessed67.2
MMLU: Nutritionunassessed83.7
MMLU: Philosophyunassessed80.4
MMLU: Prehistoryunassessed86.1
MMLU-Prounassessed47.1
MMLU: Professional Accountingunassessed64.2
MMLU: Professional Lawunassessed58.5
MMLU: Professional Medicineunassessed82.7
MMLU: Professional Psychologyunassessed81.7
MMLU: Public Relationsunassessed75.5
MMLU: Security Studiesunassessed81.6
MMLU: Sociologyunassessed89.1
MMLU: US Foreign Policyunassessed92.0
MMLU: Virologyunassessed57.8
MMLU: World Religionsunassessed90.6
MuSRunassessed44.0
TruthfulQAunassessed52.1
WinoGrandeunassessed84.0

Data

This card as JSON · Edit on GitHub