Nous Hermes 2 Yi 34B

Nous Research · nous-research/nous-hermes-2-yi-34b

ProviderNous Research
Familyyi
Typellm-chat
Statusactive
Released2023-12-23

Reported benchmark scores

These scores carry one collection date for the whole card (2024-07) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
ARC-Challengeunassessed66.9
GSM8Kunassessed70.1
HellaSwagunassessed85.5
MMLU: Abstract Algebraunassessed49.0
MMLU: Anatomyunassessed71.9
MMLU: Astronomyunassessed89.5
MMLU: Business Ethicsunassessed78.0
MMLU: Clinical Knowledgeunassessed80.0
MMLU: College Biologyunassessed90.3
MMLU: College Chemistryunassessed51.0
MMLU: College Computer Scienceunassessed65.0
MMLU: College Mathematicsunassessed49.0
MMLU: College Medicineunassessed69.9
MMLU: College Physicsunassessed52.9
MMLU: Computer Securityunassessed83.0
MMLU: Conceptual Physicsunassessed79.1
MMLU: Econometricsunassessed57.0
MMLU: Electrical Engineeringunassessed77.2
MMLU: Elementary Mathematicsunassessed69.0
MMLU: Formal Logicunassessed57.9
MMLU: Global Factsunassessed51.0
MMLU: High School Biologyunassessed89.7
MMLU: High School Chemistryunassessed62.1
MMLU: High School Computer Scienceunassessed84.0
MMLU: High School European Historyunassessed87.9
MMLU: High School Geographyunassessed89.9
MMLU: High School Government and Politicsunassessed97.9
MMLU: High School Macroeconomicsunassessed82.8
MMLU: High School Mathematicsunassessed41.5
MMLU: High School Microeconomicsunassessed85.3
MMLU: High School Physicsunassessed50.3
MMLU: High School Psychologyunassessed92.1
MMLU: High School Statisticsunassessed66.2
MMLU: High School US Historyunassessed91.2
MMLU: High School World Historyunassessed90.7
MMLU: Human Agingunassessed79.4
MMLU: Human Sexualityunassessed89.3
MMLU: International Lawunassessed90.9
MMLU: Jurisprudenceunassessed89.8
MMLU: Logical Fallaciesunassessed87.1
MMLU: Machine Learningunassessed60.7
MMLU: Managementunassessed92.2
MMLU: Marketingunassessed91.9
MMLU: Medical Geneticsunassessed86.0
MMLU: Miscellaneousunassessed91.1
MMLU: Moral Disputesunassessed83.5
MMLU: Moral Scenariosunassessed71.1
MMLU: Nutritionunassessed84.3
MMLU: Philosophyunassessed81.4
MMLU: Prehistoryunassessed88.9
MMLU: Professional Accountingunassessed64.9
MMLU: Professional Lawunassessed61.7
MMLU: Professional Medicineunassessed83.1
MMLU: Professional Psychologyunassessed82.4
MMLU: Public Relationsunassessed71.8
MMLU: Security Studiesunassessed84.1
MMLU: Sociologyunassessed87.6
MMLU: US Foreign Policyunassessed92.0
MMLU: Virologyunassessed57.2
MMLU: World Religionsunassessed87.1
TruthfulQAunassessed60.4
WinoGrandeunassessed83.0

Data

This card as JSON · Edit on GitHub