Yi 6B Chat

01.AI · 01-ai/yi-6b-chat

Provider01.AI
Familyyi
Typellm-chat
Statusactive
Released2023-11-22

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed55.5
BIG-Bench Hardunassessed41.3
GPQA Diamondunassessed29.4
GSM8Kunassessed12.1
HellaSwagunassessed76.6
IFEvalunassessed34.0
MATH-500unassessed1.4
MMLU: Abstract Algebraunassessed30.0
MMLU: Anatomyunassessed61.5
MMLU: Astronomyunassessed65.8
MMLU: Business Ethicsunassessed67.0
MMLU: Clinical Knowledgeunassessed66.8
MMLU: College Biologyunassessed66.0
MMLU: College Chemistryunassessed43.0
MMLU: College Computer Scienceunassessed51.0
MMLU: College Mathematicsunassessed42.0
MMLU: College Medicineunassessed60.7
MMLU: College Physicsunassessed34.3
MMLU: Computer Securityunassessed75.0
MMLU: Conceptual Physicsunassessed60.4
MMLU: Econometricsunassessed35.1
MMLU: Electrical Engineeringunassessed64.1
MMLU: Elementary Mathematicsunassessed45.0
MMLU: Formal Logicunassessed43.7
MMLU: Global Factsunassessed45.0
MMLU: High School Biologyunassessed77.4
MMLU: High School Chemistryunassessed53.2
MMLU: High School Computer Scienceunassessed65.0
MMLU: High School European Historyunassessed75.2
MMLU: High School Geographyunassessed82.3
MMLU: High School Government and Politicsunassessed89.6
MMLU: High School Macroeconomicsunassessed64.9
MMLU: High School Mathematicsunassessed32.6
MMLU: High School Microeconomicsunassessed73.9
MMLU: High School Physicsunassessed39.1
MMLU: High School Psychologyunassessed82.8
MMLU: High School Statisticsunassessed51.9
MMLU: High School US Historyunassessed80.9
MMLU: High School World Historyunassessed78.9
MMLU: Human Agingunassessed67.3
MMLU: Human Sexualityunassessed74.0
MMLU: International Lawunassessed76.9
MMLU: Jurisprudenceunassessed79.6
MMLU: Logical Fallaciesunassessed79.1
MMLU: Machine Learningunassessed42.0
MMLU: Managementunassessed80.6
MMLU: Marketingunassessed90.2
MMLU: Medical Geneticsunassessed79.0
MMLU: Miscellaneousunassessed80.7
MMLU: Moral Disputesunassessed69.9
MMLU: Moral Scenariosunassessed42.5
MMLU: Nutritionunassessed71.6
MMLU: Philosophyunassessed69.1
MMLU: Prehistoryunassessed71.0
MMLU-Prounassessed30.6
MMLU: Professional Accountingunassessed47.9
MMLU: Professional Lawunassessed49.5
MMLU: Professional Medicineunassessed67.3
MMLU: Professional Psychologyunassessed66.0
MMLU: Public Relationsunassessed73.6
MMLU: Security Studiesunassessed75.9
MMLU: Sociologyunassessed82.1
MMLU: US Foreign Policyunassessed85.0
MMLU: Virologyunassessed46.4
MMLU: World Religionsunassessed83.0
MuSRunassessed36.9
TruthfulQAunassessed42.0
WinoGrandeunassessed74.2

Data

This card as JSON · Edit on GitHub