Yi 1.5 6B Chat

01.AI · 01-ai/yi-1-5-6b-chat

Provider01.AI
Familyyi
Typellm-chat
Statusactive
Released2024-05-11

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed60.7
BIG-Bench Hardunassessed45.7
GPQA Diamondunassessed30.2
GSM8Kunassessed67.1
HellaSwagunassessed78.9
IFEvalunassessed51.5
MATH-500unassessed16.2
MMLU: Abstract Algebraunassessed45.0
MMLU: Anatomyunassessed51.9
MMLU: Astronomyunassessed67.1
MMLU: Business Ethicsunassessed70.0
MMLU: Clinical Knowledgeunassessed67.9
MMLU: College Biologyunassessed72.2
MMLU: College Chemistryunassessed45.0
MMLU: College Computer Scienceunassessed54.0
MMLU: College Mathematicsunassessed41.0
MMLU: College Medicineunassessed60.7
MMLU: College Physicsunassessed45.1
MMLU: Computer Securityunassessed71.0
MMLU: Conceptual Physicsunassessed64.7
MMLU: Econometricsunassessed51.8
MMLU: Electrical Engineeringunassessed63.4
MMLU: Elementary Mathematicsunassessed53.4
MMLU: Formal Logicunassessed58.7
MMLU: Global Factsunassessed42.0
MMLU: High School Biologyunassessed75.8
MMLU: High School Chemistryunassessed53.2
MMLU: High School Computer Scienceunassessed75.0
MMLU: High School European Historyunassessed78.8
MMLU: High School Geographyunassessed78.3
MMLU: High School Government and Politicsunassessed84.5
MMLU: High School Macroeconomicsunassessed66.9
MMLU: High School Mathematicsunassessed42.6
MMLU: High School Microeconomicsunassessed82.8
MMLU: High School Physicsunassessed39.1
MMLU: High School Psychologyunassessed82.4
MMLU: High School Statisticsunassessed53.2
MMLU: High School US Historyunassessed77.0
MMLU: High School World Historyunassessed78.5
MMLU: Human Agingunassessed61.0
MMLU: Human Sexualityunassessed65.6
MMLU: International Lawunassessed76.0
MMLU: Jurisprudenceunassessed77.8
MMLU: Logical Fallaciesunassessed76.7
MMLU: Machine Learningunassessed56.2
MMLU: Managementunassessed80.6
MMLU: Marketingunassessed88.9
MMLU: Medical Geneticsunassessed68.0
MMLU: Miscellaneousunassessed79.7
MMLU: Moral Disputesunassessed69.7
MMLU: Moral Scenariosunassessed38.2
MMLU: Nutritionunassessed68.0
MMLU: Philosophyunassessed64.0
MMLU: Prehistoryunassessed63.6
MMLU-Prounassessed31.9
MMLU: Professional Accountingunassessed52.1
MMLU: Professional Lawunassessed47.3
MMLU: Professional Medicineunassessed53.7
MMLU: Professional Psychologyunassessed62.3
MMLU: Public Relationsunassessed64.5
MMLU: Security Studiesunassessed68.6
MMLU: Sociologyunassessed81.1
MMLU: US Foreign Policyunassessed81.0
MMLU: Virologyunassessed50.0
MMLU: World Religionsunassessed74.3
MuSRunassessed43.9
TruthfulQAunassessed52.6
WinoGrandeunassessed73.6

Data

This card as JSON · Edit on GitHub