open-llm-leaderboard/details_Weyaxi__Dolphin2.1-OpenOrca-7B
收藏Hugging Face2023-11-09 更新2024-03-04 收录
下载链接：
https://hf-mirror.com/datasets/open-llm-leaderboard/details_Weyaxi__Dolphin2.1-OpenOrca-7B
下载链接
链接失效反馈官方服务：
资源简介：
---
pretty_name: Evaluation run of Weyaxi/Dolphin2.1-OpenOrca-7B
dataset_summary: "Dataset automatically created during the evaluation run of model\
\ [Weyaxi/Dolphin2.1-OpenOrca-7B](https://huggingface.co/Weyaxi/Dolphin2.1-OpenOrca-7B)\
\ on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).\n\
\nThe dataset is composed of 64 configuration, each one coresponding to one of the\
\ evaluated task.\n\nThe dataset has been created from 2 run(s). Each run can be\
\ found as a specific split in each configuration, the split being named using the\
\ timestamp of the run.The \"train\" split is always pointing to the latest results.\n\
\nAn additional configuration \"results\" store all the aggregated results of the\
\ run (and is used to compute and display the aggregated metrics on the [Open LLM\
\ Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)).\n\
\nTo load the details from a run, you can for instance do the following:\n```python\n\
from datasets import load_dataset\ndata = load_dataset(\"open-llm-leaderboard/details_Weyaxi__Dolphin2.1-OpenOrca-7B_public\"\
,\n\t\"harness_winogrande_5\",\n\tsplit=\"train\")\n```\n\n## Latest results\n\n\
These are the [latest results from run 2023-11-09T14:21:27.933712](https://huggingface.co/datasets/open-llm-leaderboard/details_Weyaxi__Dolphin2.1-OpenOrca-7B_public/blob/main/results_2023-11-09T14-21-27.933712.json)(note\
\ that their might be results for other tasks in the repos if successive evals didn't\
\ cover the same tasks. You find each in the results and the \"latest\" split for\
\ each eval):\n\n```python\n{\n \"all\": {\n \"acc\": 0.6224567348896717,\n\
\ \"acc_stderr\": 0.032466479047476085,\n \"acc_norm\": 0.6308724361156662,\n\
\ \"acc_norm_stderr\": 0.033159611933737225,\n \"mc1\": 0.36107711138310894,\n\
\ \"mc1_stderr\": 0.016814312844836886,\n \"mc2\": 0.538254375639854,\n\
\ \"mc2_stderr\": 0.015244755693358225,\n \"em\": 0.0030411073825503355,\n\
\ \"em_stderr\": 0.0005638896908753155,\n \"f1\": 0.08151740771812048,\n\
\ \"f1_stderr\": 0.0016591952257614033\n },\n \"harness|arc:challenge|25\"\
: {\n \"acc\": 0.6083617747440273,\n \"acc_stderr\": 0.01426412212493821,\n\
\ \"acc_norm\": 0.6416382252559727,\n \"acc_norm_stderr\": 0.014012883334859857\n\
\ },\n \"harness|hellaswag|10\": {\n \"acc\": 0.650368452499502,\n\
\ \"acc_stderr\": 0.004758790172436687,\n \"acc_norm\": 0.8424616610237005,\n\
\ \"acc_norm_stderr\": 0.0036356303524759065\n },\n \"harness|hendrycksTest-abstract_algebra|5\"\
: {\n \"acc\": 0.32,\n \"acc_stderr\": 0.046882617226215034,\n \
\ \"acc_norm\": 0.32,\n \"acc_norm_stderr\": 0.046882617226215034\n \
\ },\n \"harness|hendrycksTest-anatomy|5\": {\n \"acc\": 0.6,\n \
\ \"acc_stderr\": 0.04232073695151589,\n \"acc_norm\": 0.6,\n \"\
acc_norm_stderr\": 0.04232073695151589\n },\n \"harness|hendrycksTest-astronomy|5\"\
: {\n \"acc\": 0.6710526315789473,\n \"acc_stderr\": 0.03823428969926605,\n\
\ \"acc_norm\": 0.6710526315789473,\n \"acc_norm_stderr\": 0.03823428969926605\n\
\ },\n \"harness|hendrycksTest-business_ethics|5\": {\n \"acc\": 0.59,\n\
\ \"acc_stderr\": 0.04943110704237102,\n \"acc_norm\": 0.59,\n \
\ \"acc_norm_stderr\": 0.04943110704237102\n },\n \"harness|hendrycksTest-clinical_knowledge|5\"\
: {\n \"acc\": 0.6981132075471698,\n \"acc_stderr\": 0.02825420034443866,\n\
\ \"acc_norm\": 0.6981132075471698,\n \"acc_norm_stderr\": 0.02825420034443866\n\
\ },\n \"harness|hendrycksTest-college_biology|5\": {\n \"acc\": 0.7222222222222222,\n\
\ \"acc_stderr\": 0.037455547914624555,\n \"acc_norm\": 0.7222222222222222,\n\
\ \"acc_norm_stderr\": 0.037455547914624555\n },\n \"harness|hendrycksTest-college_chemistry|5\"\
: {\n \"acc\": 0.48,\n \"acc_stderr\": 0.050211673156867795,\n \
\ \"acc_norm\": 0.48,\n \"acc_norm_stderr\": 0.050211673156867795\n \
\ },\n \"harness|hendrycksTest-college_computer_science|5\": {\n \"\
acc\": 0.54,\n \"acc_stderr\": 0.05009082659620333,\n \"acc_norm\"\
: 0.54,\n \"acc_norm_stderr\": 0.05009082659620333\n },\n \"harness|hendrycksTest-college_mathematics|5\"\
: {\n \"acc\": 0.37,\n \"acc_stderr\": 0.04852365870939099,\n \
\ \"acc_norm\": 0.37,\n \"acc_norm_stderr\": 0.04852365870939099\n \
\ },\n \"harness|hendrycksTest-college_medicine|5\": {\n \"acc\": 0.5953757225433526,\n\
\ \"acc_stderr\": 0.03742461193887248,\n \"acc_norm\": 0.5953757225433526,\n\
\ \"acc_norm_stderr\": 0.03742461193887248\n },\n \"harness|hendrycksTest-college_physics|5\"\
: {\n \"acc\": 0.3333333333333333,\n \"acc_stderr\": 0.04690650298201943,\n\
\ \"acc_norm\": 0.3333333333333333,\n \"acc_norm_stderr\": 0.04690650298201943\n\
\ },\n \"harness|hendrycksTest-computer_security|5\": {\n \"acc\":\
\ 0.79,\n \"acc_stderr\": 0.040936018074033256,\n \"acc_norm\": 0.79,\n\
\ \"acc_norm_stderr\": 0.040936018074033256\n },\n \"harness|hendrycksTest-conceptual_physics|5\"\
: {\n \"acc\": 0.5531914893617021,\n \"acc_stderr\": 0.0325005368436584,\n\
\ \"acc_norm\": 0.5531914893617021,\n \"acc_norm_stderr\": 0.0325005368436584\n\
\ },\n \"harness|hendrycksTest-econometrics|5\": {\n \"acc\": 0.4298245614035088,\n\
\ \"acc_stderr\": 0.04657047260594963,\n \"acc_norm\": 0.4298245614035088,\n\
\ \"acc_norm_stderr\": 0.04657047260594963\n },\n \"harness|hendrycksTest-electrical_engineering|5\"\
: {\n \"acc\": 0.5793103448275863,\n \"acc_stderr\": 0.0411391498118926,\n\
\ \"acc_norm\": 0.5793103448275863,\n \"acc_norm_stderr\": 0.0411391498118926\n\
\ },\n \"harness|hendrycksTest-elementary_mathematics|5\": {\n \"acc\"\
: 0.3968253968253968,\n \"acc_stderr\": 0.025197101074246487,\n \"\
acc_norm\": 0.3968253968253968,\n \"acc_norm_stderr\": 0.025197101074246487\n\
\ },\n \"harness|hendrycksTest-formal_logic|5\": {\n \"acc\": 0.42063492063492064,\n\
\ \"acc_stderr\": 0.04415438226743744,\n \"acc_norm\": 0.42063492063492064,\n\
\ \"acc_norm_stderr\": 0.04415438226743744\n },\n \"harness|hendrycksTest-global_facts|5\"\
: {\n \"acc\": 0.3,\n \"acc_stderr\": 0.046056618647183814,\n \
\ \"acc_norm\": 0.3,\n \"acc_norm_stderr\": 0.046056618647183814\n \
\ },\n \"harness|hendrycksTest-high_school_biology|5\": {\n \"acc\": 0.7645161290322581,\n\
\ \"acc_stderr\": 0.02413763242933771,\n \"acc_norm\": 0.7645161290322581,\n\
\ \"acc_norm_stderr\": 0.02413763242933771\n },\n \"harness|hendrycksTest-high_school_chemistry|5\"\
: {\n \"acc\": 0.5024630541871922,\n \"acc_stderr\": 0.03517945038691063,\n\
\ \"acc_norm\": 0.5024630541871922,\n \"acc_norm_stderr\": 0.03517945038691063\n\
\ },\n \"harness|hendrycksTest-high_school_computer_science|5\": {\n \
\ \"acc\": 0.69,\n \"acc_stderr\": 0.04648231987117316,\n \"acc_norm\"\
: 0.69,\n \"acc_norm_stderr\": 0.04648231987117316\n },\n \"harness|hendrycksTest-high_school_european_history|5\"\
: {\n \"acc\": 0.7515151515151515,\n \"acc_stderr\": 0.03374402644139403,\n\
\ \"acc_norm\": 0.7515151515151515,\n \"acc_norm_stderr\": 0.03374402644139403\n\
\ },\n \"harness|hendrycksTest-high_school_geography|5\": {\n \"acc\"\
: 0.7727272727272727,\n \"acc_stderr\": 0.029857515673386414,\n \"\
acc_norm\": 0.7727272727272727,\n \"acc_norm_stderr\": 0.029857515673386414\n\
\ },\n \"harness|hendrycksTest-high_school_government_and_politics|5\": {\n\
\ \"acc\": 0.8652849740932642,\n \"acc_stderr\": 0.02463978909770944,\n\
\ \"acc_norm\": 0.8652849740932642,\n \"acc_norm_stderr\": 0.02463978909770944\n\
\ },\n \"harness|hendrycksTest-high_school_macroeconomics|5\": {\n \
\ \"acc\": 0.6333333333333333,\n \"acc_stderr\": 0.02443301646605246,\n \
\ \"acc_norm\": 0.6333333333333333,\n \"acc_norm_stderr\": 0.02443301646605246\n\
\ },\n \"harness|hendrycksTest-high_school_mathematics|5\": {\n \"\
acc\": 0.32592592592592595,\n \"acc_stderr\": 0.02857834836547308,\n \
\ \"acc_norm\": 0.32592592592592595,\n \"acc_norm_stderr\": 0.02857834836547308\n\
\ },\n \"harness|hendrycksTest-high_school_microeconomics|5\": {\n \
\ \"acc\": 0.6596638655462185,\n \"acc_stderr\": 0.03077805742293167,\n \
\ \"acc_norm\": 0.6596638655462185,\n \"acc_norm_stderr\": 0.03077805742293167\n\
\ },\n \"harness|hendrycksTest-high_school_physics|5\": {\n \"acc\"\
: 0.3509933774834437,\n \"acc_stderr\": 0.03896981964257375,\n \"\
acc_norm\": 0.3509933774834437,\n \"acc_norm_stderr\": 0.03896981964257375\n\
\ },\n \"harness|hendrycksTest-high_school_psychology|5\": {\n \"acc\"\
: 0.8128440366972477,\n \"acc_stderr\": 0.016722684526200148,\n \"\
acc_norm\": 0.8128440366972477,\n \"acc_norm_stderr\": 0.016722684526200148\n\
\ },\n \"harness|hendrycksTest-high_school_statistics|5\": {\n \"acc\"\
: 0.49074074074074076,\n \"acc_stderr\": 0.034093869469927006,\n \"\
acc_norm\": 0.49074074074074076,\n \"acc_norm_stderr\": 0.034093869469927006\n\
\ },\n \"harness|hendrycksTest-high_school_us_history|5\": {\n \"acc\"\
: 0.7990196078431373,\n \"acc_stderr\": 0.02812597226565437,\n \"\
acc_norm\": 0.7990196078431373,\n \"acc_norm_stderr\": 0.02812597226565437\n\
\ },\n \"harness|hendrycksTest-high_school_world_history|5\": {\n \"\
acc\": 0.7974683544303798,\n \"acc_stderr\": 0.026160568246601436,\n \
\ \"acc_norm\": 0.7974683544303798,\n \"acc_norm_stderr\": 0.026160568246601436\n\
\ },\n \"harness|hendrycksTest-human_aging|5\": {\n \"acc\": 0.6681614349775785,\n\
\ \"acc_stderr\": 0.03160295143776679,\n \"acc_norm\": 0.6681614349775785,\n\
\ \"acc_norm_stderr\": 0.03160295143776679\n },\n \"harness|hendrycksTest-human_sexuality|5\"\
: {\n \"acc\": 0.7709923664122137,\n \"acc_stderr\": 0.036853466317118506,\n\
\ \"acc_norm\": 0.7709923664122137,\n \"acc_norm_stderr\": 0.036853466317118506\n\
\ },\n \"harness|hendrycksTest-international_law|5\": {\n \"acc\":\
\ 0.7768595041322314,\n \"acc_stderr\": 0.03800754475228733,\n \"\
acc_norm\": 0.7768595041322314,\n \"acc_norm_stderr\": 0.03800754475228733\n\
\ },\n \"harness|hendrycksTest-jurisprudence|5\": {\n \"acc\": 0.7592592592592593,\n\
\ \"acc_stderr\": 0.04133119440243838,\n \"acc_norm\": 0.7592592592592593,\n\
\ \"acc_norm_stderr\": 0.04133119440243838\n },\n \"harness|hendrycksTest-logical_fallacies|5\"\
: {\n \"acc\": 0.7423312883435583,\n \"acc_stderr\": 0.03436150827846917,\n\
\ \"acc_norm\": 0.7423312883435583,\n \"acc_norm_stderr\": 0.03436150827846917\n\
\ },\n \"harness|hendrycksTest-machine_learning|5\": {\n \"acc\": 0.4642857142857143,\n\
\ \"acc_stderr\": 0.04733667890053756,\n \"acc_norm\": 0.4642857142857143,\n\
\ \"acc_norm_stderr\": 0.04733667890053756\n },\n \"harness|hendrycksTest-management|5\"\
: {\n \"acc\": 0.8058252427184466,\n \"acc_stderr\": 0.039166677628225836,\n\
\ \"acc_norm\": 0.8058252427184466,\n \"acc_norm_stderr\": 0.039166677628225836\n\
\ },\n \"harness|hendrycksTest-marketing|5\": {\n \"acc\": 0.8675213675213675,\n\
\ \"acc_stderr\": 0.02220930907316561,\n \"acc_norm\": 0.8675213675213675,\n\
\ \"acc_norm_stderr\": 0.02220930907316561\n },\n \"harness|hendrycksTest-medical_genetics|5\"\
: {\n \"acc\": 0.72,\n \"acc_stderr\": 0.04512608598542128,\n \
\ \"acc_norm\": 0.72,\n \"acc_norm_stderr\": 0.04512608598542128\n \
\ },\n \"harness|hendrycksTest-miscellaneous|5\": {\n \"acc\": 0.8058748403575989,\n\
\ \"acc_stderr\": 0.014143970276657567,\n \"acc_norm\": 0.8058748403575989,\n\
\ \"acc_norm_stderr\": 0.014143970276657567\n },\n \"harness|hendrycksTest-moral_disputes|5\"\
: {\n \"acc\": 0.7109826589595376,\n \"acc_stderr\": 0.024405173935783234,\n\
\ \"acc_norm\": 0.7109826589595376,\n \"acc_norm_stderr\": 0.024405173935783234\n\
\ },\n \"harness|hendrycksTest-moral_scenarios|5\": {\n \"acc\": 0.3340782122905028,\n\
\ \"acc_stderr\": 0.015774911422381625,\n \"acc_norm\": 0.3340782122905028,\n\
\ \"acc_norm_stderr\": 0.015774911422381625\n },\n \"harness|hendrycksTest-nutrition|5\"\
: {\n \"acc\": 0.6993464052287581,\n \"acc_stderr\": 0.026256053835718964,\n\
\ \"acc_norm\": 0.6993464052287581,\n \"acc_norm_stderr\": 0.026256053835718964\n\
\ },\n \"harness|hendrycksTest-philosophy|5\": {\n \"acc\": 0.684887459807074,\n\
\ \"acc_stderr\": 0.02638527370346449,\n \"acc_norm\": 0.684887459807074,\n\
\ \"acc_norm_stderr\": 0.02638527370346449\n },\n \"harness|hendrycksTest-prehistory|5\"\
: {\n \"acc\": 0.7191358024691358,\n \"acc_stderr\": 0.02500646975579921,\n\
\ \"acc_norm\": 0.7191358024691358,\n \"acc_norm_stderr\": 0.02500646975579921\n\
\ },\n \"harness|hendrycksTest-professional_accounting|5\": {\n \"\
acc\": 0.44680851063829785,\n \"acc_stderr\": 0.029658235097666904,\n \
\ \"acc_norm\": 0.44680851063829785,\n \"acc_norm_stderr\": 0.029658235097666904\n\
\ },\n \"harness|hendrycksTest-professional_law|5\": {\n \"acc\": 0.4621903520208605,\n\
\ \"acc_stderr\": 0.012733671880342507,\n \"acc_norm\": 0.4621903520208605,\n\
\ \"acc_norm_stderr\": 0.012733671880342507\n },\n \"harness|hendrycksTest-professional_medicine|5\"\
: {\n \"acc\": 0.6176470588235294,\n \"acc_stderr\": 0.029520095697687765,\n\
\ \"acc_norm\": 0.6176470588235294,\n \"acc_norm_stderr\": 0.029520095697687765\n\
\ },\n \"harness|hendrycksTest-professional_psychology|5\": {\n \"\
acc\": 0.6470588235294118,\n \"acc_stderr\": 0.01933314202079716,\n \
\ \"acc_norm\": 0.6470588235294118,\n \"acc_norm_stderr\": 0.01933314202079716\n\
\ },\n \"harness|hendrycksTest-public_relations|5\": {\n \"acc\": 0.6727272727272727,\n\
\ \"acc_stderr\": 0.0449429086625209,\n \"acc_norm\": 0.6727272727272727,\n\
\ \"acc_norm_stderr\": 0.0449429086625209\n },\n \"harness|hendrycksTest-security_studies|5\"\
: {\n \"acc\": 0.7183673469387755,\n \"acc_stderr\": 0.028795185574291296,\n\
\ \"acc_norm\": 0.7183673469387755,\n \"acc_norm_stderr\": 0.028795185574291296\n\
\ },\n \"harness|hendrycksTest-sociology|5\": {\n \"acc\": 0.845771144278607,\n\
\ \"acc_stderr\": 0.025538433368578337,\n \"acc_norm\": 0.845771144278607,\n\
\ \"acc_norm_stderr\": 0.025538433368578337\n },\n \"harness|hendrycksTest-us_foreign_policy|5\"\
: {\n \"acc\": 0.83,\n \"acc_stderr\": 0.0377525168068637,\n \
\ \"acc_norm\": 0.83,\n \"acc_norm_stderr\": 0.0377525168068637\n },\n\
\ \"harness|hendrycksTest-virology|5\": {\n \"acc\": 0.5421686746987951,\n\
\ \"acc_stderr\": 0.0387862677100236,\n \"acc_norm\": 0.5421686746987951,\n\
\ \"acc_norm_stderr\": 0.0387862677100236\n },\n \"harness|hendrycksTest-world_religions|5\"\
: {\n \"acc\": 0.8187134502923976,\n \"acc_stderr\": 0.029547741687640038,\n\
\ \"acc_norm\": 0.8187134502923976,\n \"acc_norm_stderr\": 0.029547741687640038\n\
\ },\n \"harness|truthfulqa:mc|0\": {\n \"mc1\": 0.36107711138310894,\n\
\ \"mc1_stderr\": 0.016814312844836886,\n \"mc2\": 0.538254375639854,\n\
\ \"mc2_stderr\": 0.015244755693358225\n },\n \"harness|winogrande|5\"\
: {\n \"acc\": 0.77663772691397,\n \"acc_stderr\": 0.011705697565205193\n\
\ },\n \"harness|drop|3\": {\n \"em\": 0.0030411073825503355,\n \
\ \"em_stderr\": 0.0005638896908753155,\n \"f1\": 0.08151740771812048,\n\
\ \"f1_stderr\": 0.0016591952257614033\n },\n \"harness|gsm8k|5\":\
\ {\n \"acc\": 0.19711902956785443,\n \"acc_stderr\": 0.01095802163030062\n\
\ }\n}\n```"
repo_url: https://huggingface.co/Weyaxi/Dolphin2.1-OpenOrca-7B
leaderboard_url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
point_of_contact: clementine@hf.co
configs:
- config_name: harness_arc_challenge_25
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|arc:challenge|25_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|arc:challenge|25_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|arc:challenge|25_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_drop_3
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|drop|3_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|drop|3_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|drop|3_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_gsm8k_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|gsm8k|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|gsm8k|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|gsm8k|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hellaswag_10
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hellaswag|10_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hellaswag|10_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hellaswag|10_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-abstract_algebra|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-anatomy|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-astronomy|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-business_ethics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-clinical_knowledge|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-college_biology|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-college_chemistry|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-college_computer_science|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-college_mathematics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-college_medicine|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-college_physics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-computer_security|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-conceptual_physics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-econometrics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-electrical_engineering|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-elementary_mathematics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-formal_logic|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-global_facts|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_biology|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_chemistry|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_computer_science|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_european_history|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_geography|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_mathematics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_microeconomics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_physics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_psychology|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_statistics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_us_history|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-high_school_world_history|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-human_aging|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-human_sexuality|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-international_law|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-jurisprudence|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-logical_fallacies|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-machine_learning|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-management|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-marketing|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-medical_genetics|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-miscellaneous|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-moral_disputes|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-moral_scenarios|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-nutrition|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-philosophy|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-prehistory|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-professional_accounting|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-professional_law|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-professional_medicine|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-professional_psychology|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-public_relations|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-security_studies|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-sociology|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-us_foreign_policy|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-virology|5_2023-11-09T14-13-23.628272.parquet'
- '**/details_harness|hendrycksTest-world_religions|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-abstract_algebra|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-anatomy|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-astronomy|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-business_ethics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-clinical_knowledge|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-college_biology|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-college_chemistry|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-college_computer_science|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-college_mathematics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-college_medicine|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-college_physics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-computer_security|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-conceptual_physics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-econometrics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-electrical_engineering|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-elementary_mathematics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-formal_logic|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-global_facts|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_biology|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_chemistry|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_computer_science|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_european_history|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_geography|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_mathematics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_microeconomics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_physics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_psychology|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_statistics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_us_history|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_world_history|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-human_aging|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-human_sexuality|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-international_law|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-jurisprudence|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-logical_fallacies|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-machine_learning|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-management|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-marketing|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-medical_genetics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-miscellaneous|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-moral_disputes|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-moral_scenarios|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-nutrition|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-philosophy|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-prehistory|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-professional_accounting|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-professional_law|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-professional_medicine|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-professional_psychology|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-public_relations|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-security_studies|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-sociology|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-us_foreign_policy|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-virology|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-world_religions|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-abstract_algebra|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-anatomy|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-astronomy|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-business_ethics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-clinical_knowledge|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-college_biology|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-college_chemistry|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-college_computer_science|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-college_mathematics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-college_medicine|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-college_physics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-computer_security|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-conceptual_physics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-econometrics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-electrical_engineering|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-elementary_mathematics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-formal_logic|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-global_facts|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_biology|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_chemistry|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_computer_science|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_european_history|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_geography|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_mathematics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_microeconomics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_physics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_psychology|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_statistics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_us_history|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-high_school_world_history|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-human_aging|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-human_sexuality|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-international_law|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-jurisprudence|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-logical_fallacies|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-machine_learning|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-management|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-marketing|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-medical_genetics|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-miscellaneous|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-moral_disputes|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-moral_scenarios|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-nutrition|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-philosophy|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-prehistory|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-professional_accounting|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-professional_law|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-professional_medicine|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-professional_psychology|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-public_relations|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-security_studies|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-sociology|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-us_foreign_policy|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-virology|5_2023-11-09T14-21-27.933712.parquet'
- '**/details_harness|hendrycksTest-world_religions|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_abstract_algebra_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-abstract_algebra|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-abstract_algebra|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-abstract_algebra|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_anatomy_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-anatomy|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-anatomy|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-anatomy|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_astronomy_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-astronomy|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-astronomy|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-astronomy|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_business_ethics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-business_ethics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-business_ethics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-business_ethics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_clinical_knowledge_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-clinical_knowledge|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-clinical_knowledge|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-clinical_knowledge|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_college_biology_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-college_biology|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-college_biology|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-college_biology|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_college_chemistry_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-college_chemistry|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-college_chemistry|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-college_chemistry|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_college_computer_science_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-college_computer_science|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-college_computer_science|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-college_computer_science|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_college_mathematics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-college_mathematics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-college_mathematics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-college_mathematics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_college_medicine_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-college_medicine|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-college_medicine|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-college_medicine|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_college_physics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-college_physics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-college_physics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-college_physics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_computer_security_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-computer_security|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-computer_security|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-computer_security|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_conceptual_physics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-conceptual_physics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-conceptual_physics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-conceptual_physics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_econometrics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-econometrics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-econometrics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-econometrics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_electrical_engineering_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-electrical_engineering|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-electrical_engineering|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-electrical_engineering|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_elementary_mathematics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-elementary_mathematics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-elementary_mathematics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-elementary_mathematics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_formal_logic_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-formal_logic|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-formal_logic|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-formal_logic|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_global_facts_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-global_facts|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-global_facts|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-global_facts|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_biology_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_biology|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_biology|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_biology|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_chemistry_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_chemistry|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_chemistry|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_chemistry|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_computer_science_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_computer_science|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_computer_science|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_computer_science|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_european_history_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_european_history|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_european_history|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_european_history|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_geography_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_geography|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_geography|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_geography|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_government_and_politics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_government_and_politics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_macroeconomics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_macroeconomics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_mathematics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_mathematics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_mathematics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_mathematics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_microeconomics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_microeconomics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_microeconomics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_microeconomics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_physics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_physics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_physics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_physics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_psychology_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_psychology|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_psychology|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_psychology|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_statistics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_statistics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_statistics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_statistics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_us_history_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_us_history|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_us_history|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_us_history|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_high_school_world_history_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-high_school_world_history|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-high_school_world_history|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-high_school_world_history|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_human_aging_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-human_aging|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-human_aging|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-human_aging|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_human_sexuality_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-human_sexuality|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-human_sexuality|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-human_sexuality|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_international_law_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-international_law|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-international_law|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-international_law|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_jurisprudence_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-jurisprudence|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-jurisprudence|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-jurisprudence|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_logical_fallacies_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-logical_fallacies|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-logical_fallacies|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-logical_fallacies|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_machine_learning_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-machine_learning|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-machine_learning|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-machine_learning|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_management_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-management|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-management|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-management|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_marketing_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-marketing|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-marketing|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-marketing|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_medical_genetics_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-medical_genetics|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-medical_genetics|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-medical_genetics|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_miscellaneous_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-miscellaneous|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-miscellaneous|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-miscellaneous|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_moral_disputes_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-moral_disputes|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-moral_disputes|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-moral_disputes|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_moral_scenarios_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-moral_scenarios|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-moral_scenarios|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-moral_scenarios|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_nutrition_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-nutrition|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-nutrition|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-nutrition|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_philosophy_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-philosophy|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-philosophy|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-philosophy|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_prehistory_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-prehistory|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-prehistory|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-prehistory|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_professional_accounting_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-professional_accounting|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-professional_accounting|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-professional_accounting|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_professional_law_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-professional_law|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-professional_law|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-professional_law|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_professional_medicine_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-professional_medicine|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-professional_medicine|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-professional_medicine|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_professional_psychology_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-professional_psychology|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-professional_psychology|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-professional_psychology|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_public_relations_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-public_relations|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-public_relations|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-public_relations|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_security_studies_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-security_studies|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-security_studies|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-security_studies|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_sociology_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-sociology|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-sociology|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-sociology|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_us_foreign_policy_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-us_foreign_policy|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-us_foreign_policy|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-us_foreign_policy|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_virology_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-virology|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-virology|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-virology|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_hendrycksTest_world_religions_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|hendrycksTest-world_religions|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|hendrycksTest-world_religions|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|hendrycksTest-world_religions|5_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_truthfulqa_mc_0
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|truthfulqa:mc|0_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|truthfulqa:mc|0_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|truthfulqa:mc|0_2023-11-09T14-21-27.933712.parquet'
- config_name: harness_winogrande_5
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- '**/details_harness|winogrande|5_2023-11-09T14-13-23.628272.parquet'
- split: 2023_11_09T14_21_27.933712
path:
- '**/details_harness|winogrande|5_2023-11-09T14-21-27.933712.parquet'
- split: latest
path:
- '**/details_harness|winogrande|5_2023-11-09T14-21-27.933712.parquet'
- config_name: results
data_files:
- split: 2023_11_09T14_13_23.628272
path:
- results_2023-11-09T14-13-23.628272.parquet
- split: 2023_11_09T14_21_27.933712
path:
- results_2023-11-09T14-21-27.933712.parquet
- split: latest
path:
- results_2023-11-09T14-21-27.933712.parquet
---
# Dataset Card for Evaluation run of Weyaxi/Dolphin2.1-OpenOrca-7B
## Dataset Description
- **Homepage:**
- **Repository:** https://huggingface.co/Weyaxi/Dolphin2.1-OpenOrca-7B
- **Paper:**
- **Leaderboard:** https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
- **Point of Contact:** clementine@hf.co
### Dataset Summary
Dataset automatically created during the evaluation run of model [Weyaxi/Dolphin2.1-OpenOrca-7B](https://huggingface.co/Weyaxi/Dolphin2.1-OpenOrca-7B) on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard).
The dataset is composed of 64 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional configuration "results" store all the aggregated results of the run (and is used to compute and display the aggregated metrics on the [Open LLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)).
To load the details from a run, you can for instance do the following:
```python
from datasets import load_dataset
data = load_dataset("open-llm-leaderboard/details_Weyaxi__Dolphin2.1-OpenOrca-7B_public",
"harness_winogrande_5",
split="train")
```
## Latest results
These are the [latest results from run 2023-11-09T14:21:27.933712](https://huggingface.co/datasets/open-llm-leaderboard/details_Weyaxi__Dolphin2.1-OpenOrca-7B_public/blob/main/results_2023-11-09T14-21-27.933712.json)(note that their might be results for other tasks in the repos if successive evals didn't cover the same tasks. You find each in the results and the "latest" split for each eval):
```python
{
"all": {
"acc": 0.6224567348896717,
"acc_stderr": 0.032466479047476085,
"acc_norm": 0.6308724361156662,
"acc_norm_stderr": 0.033159611933737225,
"mc1": 0.36107711138310894,
"mc1_stderr": 0.016814312844836886,
"mc2": 0.538254375639854,
"mc2_stderr": 0.015244755693358225,
"em": 0.0030411073825503355,
"em_stderr": 0.0005638896908753155,
"f1": 0.08151740771812048,
"f1_stderr": 0.0016591952257614033
},
"harness|arc:challenge|25": {
"acc": 0.6083617747440273,
"acc_stderr": 0.01426412212493821,
"acc_norm": 0.6416382252559727,
"acc_norm_stderr": 0.014012883334859857
},
"harness|hellaswag|10": {
"acc": 0.650368452499502,
"acc_stderr": 0.004758790172436687,
"acc_norm": 0.8424616610237005,
"acc_norm_stderr": 0.0036356303524759065
},
"harness|hendrycksTest-abstract_algebra|5": {
"acc": 0.32,
"acc_stderr": 0.046882617226215034,
"acc_norm": 0.32,
"acc_norm_stderr": 0.046882617226215034
},
"harness|hendrycksTest-anatomy|5": {
"acc": 0.6,
"acc_stderr": 0.04232073695151589,
"acc_norm": 0.6,
"acc_norm_stderr": 0.04232073695151589
},
"harness|hendrycksTest-astronomy|5": {
"acc": 0.6710526315789473,
"acc_stderr": 0.03823428969926605,
"acc_norm": 0.6710526315789473,
"acc_norm_stderr": 0.03823428969926605
},
"harness|hendrycksTest-business_ethics|5": {
"acc": 0.59,
"acc_stderr": 0.04943110704237102,
"acc_norm": 0.59,
"acc_norm_stderr": 0.04943110704237102
},
"harness|hendrycksTest-clinical_knowledge|5": {
"acc": 0.6981132075471698,
"acc_stderr": 0.02825420034443866,
"acc_norm": 0.6981132075471698,
"acc_norm_stderr": 0.02825420034443866
},
"harness|hendrycksTest-college_biology|5": {
"acc": 0.7222222222222222,
"acc_stderr": 0.037455547914624555,
"acc_norm": 0.7222222222222222,
"acc_norm_stderr": 0.037455547914624555
},
"harness|hendrycksTest-college_chemistry|5": {
"acc": 0.48,
"acc_stderr": 0.050211673156867795,
"acc_norm": 0.48,
"acc_norm_stderr": 0.050211673156867795
},
"harness|hendrycksTest-college_computer_science|5": {
"acc": 0.54,
"acc_stderr": 0.05009082659620333,
"acc_norm": 0.54,
"acc_norm_stderr": 0.05009082659620333
},
"harness|hendrycksTest-college_mathematics|5": {
"acc": 0.37,
"acc_stderr": 0.04852365870939099,
"acc_norm": 0.37,
"acc_norm_stderr": 0.04852365870939099
},
"harness|hendrycksTest-college_medicine|5": {
"acc": 0.5953757225433526,
"acc_stderr": 0.03742461193887248,
"acc_norm": 0.5953757225433526,
"acc_norm_stderr": 0.03742461193887248
},
"harness|hendrycksTest-college_physics|5": {
"acc": 0.3333333333333333,
"acc_stderr": 0.04690650298201943,
"acc_norm": 0.3333333333333333,
"acc_norm_stderr": 0.04690650298201943
},
"harness|hendrycksTest-computer_security|5": {
"acc": 0.79,
"acc_stderr": 0.040936018074033256,
"acc_norm": 0.79,
"acc_norm_stderr": 0.040936018074033256
},
"harness|hendrycksTest-conceptual_physics|5": {
"acc": 0.5531914893617021,
"acc_stderr": 0.0325005368436584,
"acc_norm": 0.5531914893617021,
"acc_norm_stderr": 0.0325005368436584
},
"harness|hendrycksTest-econometrics|5": {
"acc": 0.4298245614035088,
"acc_stderr": 0.04657047260594963,
"acc_norm": 0.4298245614035088,
"acc_norm_stderr": 0.04657047260594963
},
"harness|hendrycksTest-electrical_engineering|5": {
"acc": 0.5793103448275863,
"acc_stderr": 0.0411391498118926,
"acc_norm": 0.5793103448275863,
"acc_norm_stderr": 0.0411391498118926
},
"harness|hendrycksTest-elementary_mathematics|5": {
"acc": 0.3968253968253968,
"acc_stderr": 0.025197101074246487,
"acc_norm": 0.3968253968253968,
"acc_norm_stderr": 0.025197101074246487
},
"harness|hendrycksTest-formal_logic|5": {
"acc": 0.42063492063492064,
"acc_stderr": 0.04415438226743744,
"acc_norm": 0.42063492063492064,
"acc_norm_stderr": 0.04415438226743744
},
"harness|hendrycksTest-global_facts|5": {
"acc": 0.3,
"acc_stderr": 0.046056618647183814,
"acc_norm": 0.3,
"acc_norm_stderr": 0.046056618647183814
},
"harness|hendrycksTest-high_school_biology|5": {
"acc": 0.7645161290322581,
"acc_stderr": 0.02413763242933771,
"acc_norm": 0.7645161290322581,
"acc_norm_stderr": 0.02413763242933771
},
"harness|hendrycksTest-high_school_chemistry|5": {
"acc": 0.5024630541871922,
"acc_stderr": 0.03517945038691063,
"acc_norm": 0.5024630541871922,
"acc_norm_stderr": 0.03517945038691063
},
"harness|hendrycksTest-high_school_computer_science|5": {
"acc": 0.69,
"acc_stderr": 0.04648231987117316,
"acc_norm": 0.69,
"acc_norm_stderr": 0.04648231987117316
},
"harness|hendrycksTest-high_school_european_history|5": {
"acc": 0.7515151515151515,
"acc_stderr": 0.03374402644139403,
"acc_norm": 0.7515151515151515,
"acc_norm_stderr": 0.03374402644139403
},
"harness|hendrycksTest-high_school_geography|5": {
"acc": 0.7727272727272727,
"acc_stderr": 0.029857515673386414,
"acc_norm": 0.7727272727272727,
"acc_norm_stderr": 0.029857515673386414
},
"harness|hendrycksTest-high_school_government_and_politics|5": {
"acc": 0.8652849740932642,
"acc_stderr": 0.02463978909770944,
"acc_norm": 0.8652849740932642,
"acc_norm_stderr": 0.02463978909770944
},
"harness|hendrycksTest-high_school_macroeconomics|5": {
"acc": 0.6333333333333333,
"acc_stderr": 0.02443301646605246,
"acc_norm": 0.6333333333333333,
"acc_norm_stderr": 0.02443301646605246
},
"harness|hendrycksTest-high_school_mathematics|5": {
"acc": 0.32592592592592595,
"acc_stderr": 0.02857834836547308,
"acc_norm": 0.32592592592592595,
"acc_norm_stderr": 0.02857834836547308
},
"harness|hendrycksTest-high_school_microeconomics|5": {
"acc": 0.6596638655462185,
"acc_stderr": 0.03077805742293167,
"acc_norm": 0.6596638655462185,
"acc_norm_stderr": 0.03077805742293167
},
"harness|hendrycksTest-high_school_physics|5": {
"acc": 0.3509933774834437,
"acc_stderr": 0.03896981964257375,
"acc_norm": 0.3509933774834437,
"acc_norm_stderr": 0.03896981964257375
},
"harness|hendrycksTest-high_school_psychology|5": {
"acc": 0.8128440366972477,
"acc_stderr": 0.016722684526200148,
"acc_norm": 0.8128440366972477,
"acc_norm_stderr": 0.016722684526200148
},
"harness|hendrycksTest-high_school_statistics|5": {
"acc": 0.49074074074074076,
"acc_stderr": 0.034093869469927006,
"acc_norm": 0.49074074074074076,
"acc_norm_stderr": 0.034093869469927006
},
"harness|hendrycksTest-high_school_us_history|5": {
"acc": 0.7990196078431373,
"acc_stderr": 0.02812597226565437,
"acc_norm": 0.7990196078431373,
"acc_norm_stderr": 0.02812597226565437
},
"harness|hendrycksTest-high_school_world_history|5": {
"acc": 0.7974683544303798,
"acc_stderr": 0.026160568246601436,
"acc_norm": 0.7974683544303798,
"acc_norm_stderr": 0.026160568246601436
},
"harness|hendrycksTest-human_aging|5": {
"acc": 0.6681614349775785,
"acc_stderr": 0.03160295143776679,
"acc_norm": 0.6681614349775785,
"acc_norm_stderr": 0.03160295143776679
},
"harness|hendrycksTest-human_sexuality|5": {
"acc": 0.7709923664122137,
"acc_stderr": 0.036853466317118506,
"acc_norm": 0.7709923664122137,
"acc_norm_stderr": 0.036853466317118506
},
"harness|hendrycksTest-international_law|5": {
"acc": 0.7768595041322314,
"acc_stderr": 0.03800754475228733,
"acc_norm": 0.7768595041322314,
"acc_norm_stderr": 0.03800754475228733
},
"harness|hendrycksTest-jurisprudence|5": {
"acc": 0.7592592592592593,
"acc_stderr": 0.04133119440243838,
"acc_norm": 0.7592592592592593,
"acc_norm_stderr": 0.04133119440243838
},
"harness|hendrycksTest-logical_fallacies|5": {
"acc": 0.7423312883435583,
"acc_stderr": 0.03436150827846917,
"acc_norm": 0.7423312883435583,
"acc_norm_stderr": 0.03436150827846917
},
"harness|hendrycksTest-machine_learning|5": {
"acc": 0.4642857142857143,
"acc_stderr": 0.04733667890053756,
"acc_norm": 0.4642857142857143,
"acc_norm_stderr": 0.04733667890053756
},
"harness|hendrycksTest-management|5": {
"acc": 0.8058252427184466,
"acc_stderr": 0.039166677628225836,
"acc_norm": 0.8058252427184466,
"acc_norm_stderr": 0.039166677628225836
},
"harness|hendrycksTest-marketing|5": {
"acc": 0.8675213675213675,
"acc_stderr": 0.02220930907316561,
"acc_norm": 0.8675213675213675,
"acc_norm_stderr": 0.02220930907316561
},
"harness|hendrycksTest-medical_genetics|5": {
"acc": 0.72,
"acc_stderr": 0.04512608598542128,
"acc_norm": 0.72,
"acc_norm_stderr": 0.04512608598542128
},
"harness|hendrycksTest-miscellaneous|5": {
"acc": 0.8058748403575989,
"acc_stderr": 0.014143970276657567,
"acc_norm": 0.8058748403575989,
"acc_norm_stderr": 0.014143970276657567
},
"harness|hendrycksTest-moral_disputes|5": {
"acc": 0.7109826589595376,
"acc_stderr": 0.024405173935783234,
"acc_norm": 0.7109826589595376,
"acc_norm_stderr": 0.024405173935783234
},
"harness|hendrycksTest-moral_scenarios|5": {
"acc": 0.3340782122905028,
"acc_stderr": 0.015774911422381625,
"acc_norm": 0.3340782122905028,
"acc_norm_stderr": 0.015774911422381625
},
"harness|hendrycksTest-nutrition|5": {
"acc": 0.6993464052287581,
"acc_stderr": 0.026256053835718964,
"acc_norm": 0.6993464052287581,
"acc_norm_stderr": 0.026256053835718964
},
"harness|hendrycksTest-philosophy|5": {
"acc": 0.684887459807074,
"acc_stderr": 0.02638527370346449,
"acc_norm": 0.684887459807074,
"acc_norm_stderr": 0.02638527370346449
},
"harness|hendrycksTest-prehistory|5": {
"acc": 0.7191358024691358,
"acc_stderr": 0.02500646975579921,
"acc_norm": 0.7191358024691358,
"acc_norm_stderr": 0.02500646975579921
},
"harness|hendrycksTest-professional_accounting|5": {
"acc": 0.44680851063829785,
"acc_stderr": 0.029658235097666904,
"acc_norm": 0.44680851063829785,
"acc_norm_stderr": 0.029658235097666904
},
"harness|hendrycksTest-professional_law|5": {
"acc": 0.4621903520208605,
"acc_stderr": 0.012733671880342507,
"acc_norm": 0.4621903520208605,
"acc_norm_stderr": 0.012733671880342507
},
"harness|hendrycksTest-professional_medicine|5": {
"acc": 0.6176470588235294,
"acc_stderr": 0.029520095697687765,
"acc_norm": 0.6176470588235294,
"acc_norm_stderr": 0.029520095697687765
},
"harness|hendrycksTest-professional_psychology|5": {
"acc": 0.6470588235294118,
"acc_stderr": 0.01933314202079716,
"acc_norm": 0.6470588235294118,
"acc_norm_stderr": 0.01933314202079716
},
"harness|hendrycksTest-public_relations|5": {
"acc": 0.6727272727272727,
"acc_stderr": 0.0449429086625209,
"acc_norm": 0.6727272727272727,
"acc_norm_stderr": 0.0449429086625209
},
"harness|hendrycksTest-security_studies|5": {
"acc": 0.7183673469387755,
"acc_stderr": 0.028795185574291296,
"acc_norm": 0.7183673469387755,
"acc_norm_stderr": 0.028795185574291296
},
"harness|hendrycksTest-sociology|5": {
"acc": 0.845771144278607,
"acc_stderr": 0.025538433368578337,
"acc_norm": 0.845771144278607,
"acc_norm_stderr": 0.025538433368578337
},
"harness|hendrycksTest-us_foreign_policy|5": {
"acc": 0.83,
"acc_stderr": 0.0377525168068637,
"acc_norm": 0.83,
"acc_norm_stderr": 0.0377525168068637
},
"harness|hendrycksTest-virology|5": {
"acc": 0.5421686746987951,
"acc_stderr": 0.0387862677100236,
"acc_norm": 0.5421686746987951,
"acc_norm_stderr": 0.0387862677100236
},
"harness|hendrycksTest-world_religions|5": {
"acc": 0.8187134502923976,
"acc_stderr": 0.029547741687640038,
"acc_norm": 0.8187134502923976,
"acc_norm_stderr": 0.029547741687640038
},
"harness|truthfulqa:mc|0": {
"mc1": 0.36107711138310894,
"mc1_stderr": 0.016814312844836886,
"mc2": 0.538254375639854,
"mc2_stderr": 0.015244755693358225
},
"harness|winogrande|5": {
"acc": 0.77663772691397,
"acc_stderr": 0.011705697565205193
},
"harness|drop|3": {
"em": 0.0030411073825503355,
"em_stderr": 0.0005638896908753155,
"f1": 0.08151740771812048,
"f1_stderr": 0.0016591952257614033
},
"harness|gsm8k|5": {
"acc": 0.19711902956785443,
"acc_stderr": 0.01095802163030062
}
}
```
### Supported Tasks and Leaderboards
[More Information Needed]
### Languages
[More Information Needed]
## Dataset Structure
### Data Instances
[More Information Needed]
### Data Fields
[More Information Needed]
### Data Splits
[More Information Needed]
## Dataset Creation
### Curation Rationale
[More Information Needed]
### Source Data
#### Initial Data Collection and Normalization
[More Information Needed]
#### Who are the source language producers?
[More Information Needed]
### Annotations
#### Annotation process
[More Information Needed]
#### Who are the annotators?
[More Information Needed]
### Personal and Sensitive Information
[More Information Needed]
## Considerations for Using the Data
### Social Impact of Dataset
[More Information Needed]
### Discussion of Biases
[More Information Needed]
### Other Known Limitations
[More Information Needed]
## Additional Information
### Dataset Curators
[More Information Needed]
### Licensing Information
[More Information Needed]
### Citation Information
[More Information Needed]
### Contributions
[More Information Needed]
提供机构：
open-llm-leaderboard原始信息汇总
数据集概述
数据集摘要
该数据集是在评估模型 Weyaxi/Dolphin2.1-OpenOrca-7B 在 Open LLM Leaderboard 上的自动创建的。数据集包含 64 个配置，每个配置对应一个评估任务。数据集从 2 次运行中创建，每次运行可以在每个配置中找到特定的分割，分割名称使用运行的时间戳。"train" 分割始终指向最新的结果。
数据集结构
数据集包含多个配置，每个配置对应不同的评估任务。以下是部分配置的详细信息：
-
harness_arc_challenge_25:
- 分割: 2023_11_09T14_13_23.628272
- 路径:
**/details_harness|arc:challenge|25_2023-11-09T14-13-23.628272.parquet
- 路径:
- 分割: 2023_11_09T14_21_27.933712
- 路径:
**/details_harness|arc:challenge|25_2023-11-09T14-21-27.933712.parquet
- 路径:
- 分割: latest
- 路径:
**/details_harness|arc:challenge|25_2023-11-09T14-21-27.933712.parquet
- 路径:
- 分割: 2023_11_09T14_13_23.628272
-
harness_drop_3:
- 分割: 2023_11_09T14_13_23.628272
- 路径:
**/details_harness|drop|3_2023-11-09T14-13-23.628272.parquet
- 路径:
- 分割: 2023_11_09T14_21_27.933712
- 路径:
**/details_harness|drop|3_2023-11-09T14-21-27.933712.parquet
- 路径:
- 分割: latest
- 路径:
**/details_harness|drop|3_2023-11-09T14-21-27.933712.parquet
- 路径:
- 分割: 2023_11_09T14_13_23.628272
-
harness_gsm8k_5:
- 分割: 2023_11_09T14_13_23.628272
- 路径:
**/details_harness|gsm8k|5_2023-11-09T14-13-23.628272.parquet
- 路径:
- 分割: 2023_11_09T14_21_27.933712
- 路径:
**/details_harness|gsm8k|5_2023-11-09T14-21-27.933712.parquet
- 路径:
- 分割: latest
- 路径:
**/details_harness|gsm8k|5_2023-11-09T14-21-27.933712.parquet
- 路径:
- 分割: 2023_11_09T14_13_23.628272
-
harness_hellaswag_10:
- 分割: 2023_11_09T14_13_23.628272
- 路径:
**/details_harness|hellaswag|10_2023-11-09T14-13-23.628272.parquet
- 路径:
- 分割: 2023_11_09T14_21_27.933712
- 路径:
**/details_harness|hellaswag|10_2023-11-09T14-21-27.933712.parquet
- 路径:
- 分割: latest
- 路径:
**/details_harness|hellaswag|10_2023-11-09T14-21-27.933712.parquet
- 路径:
- 分割: 2023_11_09T14_13_23.628272
-
harness_hendrycksTest_5:
- 分割: 2023_11_09T14_13_23.628272
- 路径:
**/details_harness|hendrycksTest-abstract_algebra|5_2023-11-09T14-13-23.628272.parquet**/details_harness|hendrycksTest-anatomy|5_2023-11-09T14-13-23.628272.parquet**/details_harness|hendrycksTest-astronomy|5_2023-11-09T14-13-23.628272.parquet**/details_harness|hendrycksTest-business_ethics|5_2023-11-09T14-13-23.628272.parquet**/details_harness|hendrycksTest-clinical_knowledge|5_2023-11-09T14-13-23.628272.parquet**/details_harness|hendrycksTest-college_biology|5_2023-11-09T14-13-23.628272.parquet**/details_harness|hendrycksTest-college_chemistry|5_2023-11-09T14-13-23.628272.parquet
- 路径:
- 分割: 2023_11_09T14_13_23.628272
最新结果
以下是 2023-11-09T14:21:27.933712 运行 的最新结果：
python { "all": { "acc": 0.6224567348896717, "acc_stderr": 0.032466479047476085, "acc_norm": 0.6308724361156662, "acc_norm_stderr": 0.033159611933737225, "mc1": 0.36107711138310894, "mc1_stderr": 0.016814312844836886, "mc2": 0.538254375639854, "mc2_stderr": 0.015244755693358225, "em": 0.0030411073825503355, "em_stderr": 0.0005638896908753155, "f1": 0.08151740771812048, "f1_stderr": 0.0016591952257614033 }, "harness|arc:challenge|25": { "acc": 0.6083617747440273, "acc_stderr": 0.01426412212493821, "acc_norm": 0.6416382252559727, "acc_norm_stderr": 0.014012883334859857 }, "harness|hellaswag|10": { "acc": 0.650368452499502, "acc_stderr": 0.004758790172436687, "acc_norm": 0.8424616610237005, "acc_norm_stderr": 0.0036356303524759065 }, "harness|hendrycksTest-abstract_algebra|5": { "acc": 0.32, "acc_stderr": 0.046882617226215034, "acc_norm": 0.32, "acc_norm_stderr": 0.046882617226215034 }, "harness|hendrycksTest-anatomy|5": { "acc": 0.6, "acc_stderr": 0.04232073695151589, "acc_norm": 0.6, "acc_norm_stderr": 0.04232073695151589 }, "harness|hendrycksTest-astronomy|5": { "acc": 0.6710526315789473, "acc_stderr": 0.03823428969926605, "acc_norm": 0.6710526315789473, "acc_norm_stderr": 0.03823428969926605 }, "harness|hendrycksTest-business_ethics|5": { "acc": 0.59, "acc_stderr": 0.04943110704237102, "acc_norm": 0.59, "acc_norm_stderr": 0.04943110704237102 }, "harness|hendrycksTest-clinical_knowledge|5": { "acc": 0.6981132075471698, "acc_stderr": 0.02825420034443866, "acc_norm": 0.6981132075471698, "acc_norm_stderr": 0.02825420034443866 }, "harness|hendrycksTest-college_biology|5": { "acc": 0.7222222222222222, "acc_stderr": 0.037455547914624555, "acc_norm": 0.7222222222222222, "acc_norm_stderr": 0.037455547914624555 }, "harness|hendrycksTest-college_chemistry|5": { "acc": 0.48, "acc_stderr": 0.050211673156867795, "acc_norm": 0.48, "acc_norm_stderr": 0.050211673156867795 }, "harness|hendrycksTest-college_computer_science|5": { "acc": 0.54, "acc_stderr": 0.05009082659620333, "acc_norm": 0.54, "acc_norm_stderr": 0.05009082659620333 }, "harness|hendrycksTest-college_mathematics|5": { "acc": 0.37, "acc_stderr": 0.04852365870939099, "acc_norm": 0.37, "acc_norm_stderr": 0.04852365870939099 }, "harness|hendrycksTest-college_medicine|5": { "acc": 0.5953757225433526, "acc_stderr": 0.03742461193887248, "acc_norm": 0.5953757225433526, "acc_norm_stderr": 0.03742461193887248 }, "harness|hendrycksTest-college_physics|5": { "acc": 0.3333333333333333, "acc_stderr": 0.04690650298201943, "acc_norm": 0.3333333333333333, "acc_norm_stderr": 0.04690650298201943 }, "harness|hendrycksTest-computer_security|5": { "acc": 0.79, "acc_stderr": 0.040936018074033256, "acc_norm": 0.79, "acc_norm_stderr": 0.040936018074033256 }, "harness|hendrycksTest-conceptual_physics|5": { "acc": 0.5531914893617021, "acc_stderr": 0.0325005368436584, "acc_norm": 0.5531914893617021, "acc_norm_stderr": 0.0325005368436584 }, "harness|hendrycksTest-econometrics|5": { "acc": 0.4298245614035088, "acc_stderr": 0.04657047260594963, "acc_norm": 0.4298245614035088, "acc_norm_stderr": 0.04657047260594963 }, "harness|hendrycksTest-electrical_engineering|5": { "acc": 0.5793103448275863, "acc_stderr": 0.0411391498118926, "acc_norm": 0.5793103448275863, "acc_norm_stderr": 0.0411391498118926 }, "harness|hendrycksTest-elementary_mathematics|5": { "acc": 0.3968253968253968, "acc_stderr": 0.02519710107
搜集汇总
数据集介绍
构建方式
在大语言模型评测领域，精准的基准测试是衡量模型能力的关键。该数据集源于对Weyaxi/Dolphin2.1-OpenOrca-7B模型在Open LLM Leaderboard上的评估过程，自动构建而成。其构建逻辑围绕64个评测任务展开，每个任务对应一个独立的配置项，涵盖了从常识推理到专业学科知识的多元维度。数据集记录了两次运行的结果，每次运行作为一个独立的分割（split），以时间戳命名，而“train”分割则始终指向最新一次运行的数据。此外，一个名为“results”的额外配置存储了所有任务的聚合指标，用于在排行榜上计算和展示整体性能。这种设计确保了评估过程的透明性与结果的可追溯性。
特点
该数据集最显著的特点在于其结构化的多任务与多分割设计。64个配置项分别对应诸如ARC挑战赛、HellaSwag、GSM8K及涵盖57个学科的MMLU等评测基准，实现了对模型在推理、知识、数学等多维度能力的细粒度刻画。每个配置下的数据分割以时间戳标识，允许用户对比不同时间点的模型表现，而“latest”分割自动指向最新结果，简化了访问流程。这种分层的组织方式不仅提供了丰富的评测细节，还通过聚合的“results”配置，使用户能一键获取模型的宏观性能指标，兼具了微观分析与宏观评估的双重优势。
使用方法
使用该数据集进行模型性能分析时，可通过Hugging Face的datasets库直接加载。用户需指定目标配置名称与所需的分割，例如，加载winogrande任务的训练分割，可调用load_dataset函数并传入相应配置名与split='train'参数。配置名称对应于评测任务，如'harness_winogrande_5'，而分割则包括具体的时间戳或'latest'。对于需要全局概览的场景，可加载'results'配置以获取所有任务的聚合得分。这种加载方式灵活，既能深入探究单一任务的细节，也能快速把握模型的整体实力，为研究者和开发者提供了便捷的评估工具。
背景与挑战
背景概述
该数据集源于HuggingFace社区发起的Open LLM Leaderboard评估计划，旨在系统性地衡量大语言模型在多样化自然语言理解与推理任务上的表现。由HuggingFace团队于2023年主导创建，核心研究问题聚焦于如何通过标准化、可复现的评估框架，揭示模型在常识推理、数学解题、多领域知识掌握及对抗性生成等维度上的真实能力。数据集记录了Weyaxi/Dolphin2.1-OpenOrca-7B模型在64个细分任务配置上的详细评估结果，涵盖ARC挑战赛、HellaSwag、MMLU、TruthfulQA、Winogrande、DROP及GSM8K等经典基准，为模型性能比较与算法迭代提供了坚实的量化基础。其影响力不仅体现在推动开源模型透明度与公平性评估，更通过公开细粒度结果，促进了社区对模型弱点与优势的深入理解。
当前挑战
当前数据集面临的核心挑战包括：其一，所解决的领域问题在于大语言模型评估的全面性与公平性难以保障，单一基准无法覆盖模型在逻辑推理、事实一致性、数学计算及对抗鲁棒性等多维度的真实表现，导致模型优劣判断存在偏差；其二，构建过程中遭遇技术复杂性，需协调64个异构任务的数据格式与评估协议，确保不同任务间的评分标准统一且可复现，同时处理模型多次运行结果的时间戳对齐与版本管理问题；其三，数据集的动态更新特性要求持续维护，新模型与任务的加入需保持评估流程的兼容性与历史结果的可比性，这对自动化管线的稳定性和元数据记录精度提出了严苛要求。
常用场景
经典使用场景
在大型语言模型（LLM）评估领域，该数据集作为Open LLM Leaderboard的标准化评测工具，被广泛用于对Weyaxi/Dolphin2.1-OpenOrca-7B模型进行多维度能力检验。其核心应用涵盖常识推理（如ARC-Challenge、HellaSwag）、数学解题（GSM8K）、文本理解与生成（DROP）以及涵盖57个学科的世界知识测试（MMLU）。通过精细化的任务配置和分次运行记录，研究者可系统性地分析模型在零样本或少样本设定下的表现，尤其适用于对比不同训练策略、模型架构或微调方法对泛化能力的影响。该数据集的64个配置项和分片结构，为可重复的模型评估提供了严谨的基准框架。
衍生相关工作
围绕该数据集衍生了多项开创性研究工作。在模型优化方面，研究者基于其评测结果提出了针对性微调策略，如通过MMLU子集的错误分析改进知识蒸馏方法。在评估方法论上，该数据集启发了多任务联合学习框架的设计，例如利用HellaSwag与ARC-Challenge的互补性来训练更鲁棒的推理模型。此外，其分片运行机制催生了动态评估工具的开发，使得模型性能的时间演化分析成为可能。更为深远的是，该数据集作为Open LLM Leaderboard的组成部分，推动了社区标准化评估生态的形成，直接影响了如AlpacaEval、LMSys Chatbot Arena等后续基准的构建理念，成为LLM比较研究的重要参照系。
数据集最近研究
最新研究方向
当前，大语言模型（LLM）的性能评估已成为推动模型迭代与优化的核心驱动力，而开放式排行榜（Open LLM Leaderboard）则扮演着标准化竞技场的角色。围绕Weyaxi/Dolphin2.1-OpenOrca-7B这一模型的评估数据集，前沿研究方向聚焦于构建多维度的细粒度评测体系。该数据集不仅涵盖了ARC挑战赛、HellaSwag等通用推理任务，更深入至HendrycksTest所代表的57个学科领域，从抽象代数到病毒学，全面检验模型在专业知识和逻辑推理上的综合能力。这一评测框架的演进，与当前业界对LLM在复杂场景下可靠性、知识广度及对齐性的高度关注紧密相连。其意义在于，通过公开、可复现的评测记录（如本数据集对多次运行结果的详尽存储），研究者能够精准定位模型在不同认知任务中的优势与短板，从而引导后续研究从单纯追求参数规模转向更精细化的能力提升与知识蒸馏策略，为构建更安全、更博学的通用人工智能奠定实证基础。
以上内容由遇见数据集搜集并总结生成
