OALL/details_SicariusSicariiStuff__Qwen2.5-14B_Uncensored_Instruct
收藏Hugging Face2024-09-22 更新2025-04-12 收录
下载链接：
https://hf-mirror.com/datasets/OALL/details_SicariusSicariiStuff__Qwen2.5-14B_Uncensored_Instruct
下载链接
链接失效反馈官方服务：
资源简介：
---
pretty_name: Evaluation run of SicariusSicariiStuff/Qwen2.5-14B_Uncensored_Instruct
dataset_summary: "Dataset automatically created during the evaluation run of model\
\ [SicariusSicariiStuff/Qwen2.5-14B_Uncensored_Instruct](https://huggingface.co/SicariusSicariiStuff/Qwen2.5-14B_Uncensored_Instruct).\n\
\nThe dataset is composed of 136 configuration, each one coresponding to one of\
\ the evaluated task.\n\nThe dataset has been created from 1 run(s). Each run can\
\ be found as a specific split in each configuration, the split being named using\
\ the timestamp of the run.The \"train\" split is always pointing to the latest\
\ results.\n\nAn additional configuration \"results\" store all the aggregated results\
\ of the run.\n\nTo load the details from a run, you can for instance do the following:\n\
```python\nfrom datasets import load_dataset\ndata = load_dataset(\"OALL/details_SicariusSicariiStuff__Qwen2.5-14B_Uncensored_Instruct\"\
,\n\t\"lighteval_xstory_cloze_ar_0\",\n\tsplit=\"train\")\n```\n\n## Latest results\n\
\nThese are the [latest results from run 2024-09-22T05:29:20.135186](https://huggingface.co/datasets/OALL/details_SicariusSicariiStuff__Qwen2.5-14B_Uncensored_Instruct/blob/main/results_2024-09-22T05-29-20.135186.json)(note\
\ that their might be results for other tasks in the repos if successive evals didn't\
\ cover the same tasks. You find each in the results and the \"latest\" split for\
\ each eval):\n\n```python\n{\n \"all\": {\n \"acc_norm\": 0.4849295787346353,\n\
\ \"acc_norm_stderr\": 0.037708800564913825,\n \"acc\": 0.6644606221045665,\n\
\ \"acc_stderr\": 0.012151164438163903\n },\n \"community|acva:Algeria|0\"\
: {\n \"acc_norm\": 0.5230769230769231,\n \"acc_norm_stderr\": 0.0358596530894741\n\
\ },\n \"community|acva:Ancient_Egypt|0\": {\n \"acc_norm\": 0.050793650793650794,\n\
\ \"acc_norm_stderr\": 0.01239139518482262\n },\n \"community|acva:Arab_Empire|0\"\
: {\n \"acc_norm\": 0.30943396226415093,\n \"acc_norm_stderr\": 0.028450154794118627\n\
\ },\n \"community|acva:Arabic_Architecture|0\": {\n \"acc_norm\":\
\ 0.4564102564102564,\n \"acc_norm_stderr\": 0.035761230969912135\n },\n\
\ \"community|acva:Arabic_Art|0\": {\n \"acc_norm\": 0.3641025641025641,\n\
\ \"acc_norm_stderr\": 0.03454653867786389\n },\n \"community|acva:Arabic_Astronomy|0\"\
: {\n \"acc_norm\": 0.4666666666666667,\n \"acc_norm_stderr\": 0.03581804596782233\n\
\ },\n \"community|acva:Arabic_Calligraphy|0\": {\n \"acc_norm\": 0.47843137254901963,\n\
\ \"acc_norm_stderr\": 0.0313435870640056\n },\n \"community|acva:Arabic_Ceremony|0\"\
: {\n \"acc_norm\": 0.518918918918919,\n \"acc_norm_stderr\": 0.036834092970087065\n\
\ },\n \"community|acva:Arabic_Clothing|0\": {\n \"acc_norm\": 0.5128205128205128,\n\
\ \"acc_norm_stderr\": 0.03588610523192215\n },\n \"community|acva:Arabic_Culture|0\"\
: {\n \"acc_norm\": 0.23076923076923078,\n \"acc_norm_stderr\": 0.0302493752938313\n\
\ },\n \"community|acva:Arabic_Food|0\": {\n \"acc_norm\": 0.441025641025641,\n\
\ \"acc_norm_stderr\": 0.0356473293185358\n },\n \"community|acva:Arabic_Funeral|0\"\
: {\n \"acc_norm\": 0.4,\n \"acc_norm_stderr\": 0.050529115263991134\n\
\ },\n \"community|acva:Arabic_Geography|0\": {\n \"acc_norm\": 0.6206896551724138,\n\
\ \"acc_norm_stderr\": 0.040434618619167466\n },\n \"community|acva:Arabic_History|0\"\
: {\n \"acc_norm\": 0.30256410256410254,\n \"acc_norm_stderr\": 0.03298070870085619\n\
\ },\n \"community|acva:Arabic_Language_Origin|0\": {\n \"acc_norm\"\
: 0.5473684210526316,\n \"acc_norm_stderr\": 0.051339113773544845\n },\n\
\ \"community|acva:Arabic_Literature|0\": {\n \"acc_norm\": 0.4689655172413793,\n\
\ \"acc_norm_stderr\": 0.04158632762097828\n },\n \"community|acva:Arabic_Math|0\"\
: {\n \"acc_norm\": 0.30256410256410254,\n \"acc_norm_stderr\": 0.03298070870085618\n\
\ },\n \"community|acva:Arabic_Medicine|0\": {\n \"acc_norm\": 0.46206896551724136,\n\
\ \"acc_norm_stderr\": 0.041546596717075474\n },\n \"community|acva:Arabic_Music|0\"\
: {\n \"acc_norm\": 0.23741007194244604,\n \"acc_norm_stderr\": 0.036220593237998276\n\
\ },\n \"community|acva:Arabic_Ornament|0\": {\n \"acc_norm\": 0.4717948717948718,\n\
\ \"acc_norm_stderr\": 0.035840746749208334\n },\n \"community|acva:Arabic_Philosophy|0\"\
: {\n \"acc_norm\": 0.5793103448275863,\n \"acc_norm_stderr\": 0.0411391498118926\n\
\ },\n \"community|acva:Arabic_Physics_and_Chemistry|0\": {\n \"acc_norm\"\
: 0.5333333333333333,\n \"acc_norm_stderr\": 0.03581804596782232\n },\n\
\ \"community|acva:Arabic_Wedding|0\": {\n \"acc_norm\": 0.41025641025641024,\n\
\ \"acc_norm_stderr\": 0.03531493712326671\n },\n \"community|acva:Bahrain|0\"\
: {\n \"acc_norm\": 0.3111111111111111,\n \"acc_norm_stderr\": 0.06979205927323111\n\
\ },\n \"community|acva:Comoros|0\": {\n \"acc_norm\": 0.37777777777777777,\n\
\ \"acc_norm_stderr\": 0.07309112127323451\n },\n \"community|acva:Egypt_modern|0\"\
: {\n \"acc_norm\": 0.3157894736842105,\n \"acc_norm_stderr\": 0.04794350420740798\n\
\ },\n \"community|acva:InfluenceFromAncientEgypt|0\": {\n \"acc_norm\"\
: 0.6051282051282051,\n \"acc_norm_stderr\": 0.03509545602262038\n },\n\
\ \"community|acva:InfluenceFromByzantium|0\": {\n \"acc_norm\": 0.7172413793103448,\n\
\ \"acc_norm_stderr\": 0.03752833958003337\n },\n \"community|acva:InfluenceFromChina|0\"\
: {\n \"acc_norm\": 0.26666666666666666,\n \"acc_norm_stderr\": 0.0317493043641267\n\
\ },\n \"community|acva:InfluenceFromGreece|0\": {\n \"acc_norm\":\
\ 0.6307692307692307,\n \"acc_norm_stderr\": 0.034648411418637566\n },\n\
\ \"community|acva:InfluenceFromIslam|0\": {\n \"acc_norm\": 0.296551724137931,\n\
\ \"acc_norm_stderr\": 0.03806142687309993\n },\n \"community|acva:InfluenceFromPersia|0\"\
: {\n \"acc_norm\": 0.6971428571428572,\n \"acc_norm_stderr\": 0.03483414676585986\n\
\ },\n \"community|acva:InfluenceFromRome|0\": {\n \"acc_norm\": 0.5743589743589743,\n\
\ \"acc_norm_stderr\": 0.03549871080367708\n },\n \"community|acva:Iraq|0\"\
: {\n \"acc_norm\": 0.5058823529411764,\n \"acc_norm_stderr\": 0.05455069703232772\n\
\ },\n \"community|acva:Islam_Education|0\": {\n \"acc_norm\": 0.4512820512820513,\n\
\ \"acc_norm_stderr\": 0.03572709860318392\n },\n \"community|acva:Islam_branches_and_schools|0\"\
: {\n \"acc_norm\": 0.4342857142857143,\n \"acc_norm_stderr\": 0.037576101528126626\n\
\ },\n \"community|acva:Islamic_law_system|0\": {\n \"acc_norm\": 0.4256410256410256,\n\
\ \"acc_norm_stderr\": 0.035498710803677086\n },\n \"community|acva:Jordan|0\"\
: {\n \"acc_norm\": 0.3333333333333333,\n \"acc_norm_stderr\": 0.07106690545187012\n\
\ },\n \"community|acva:Kuwait|0\": {\n \"acc_norm\": 0.26666666666666666,\n\
\ \"acc_norm_stderr\": 0.06666666666666667\n },\n \"community|acva:Lebanon|0\"\
: {\n \"acc_norm\": 0.17777777777777778,\n \"acc_norm_stderr\": 0.05763774795025094\n\
\ },\n \"community|acva:Libya|0\": {\n \"acc_norm\": 0.4444444444444444,\n\
\ \"acc_norm_stderr\": 0.07491109582924914\n },\n \"community|acva:Mauritania|0\"\
: {\n \"acc_norm\": 0.4222222222222222,\n \"acc_norm_stderr\": 0.07446027270295805\n\
\ },\n \"community|acva:Mesopotamia_civilization|0\": {\n \"acc_norm\"\
: 0.5225806451612903,\n \"acc_norm_stderr\": 0.0402500394824441\n },\n\
\ \"community|acva:Morocco|0\": {\n \"acc_norm\": 0.2222222222222222,\n\
\ \"acc_norm_stderr\": 0.06267511942419628\n },\n \"community|acva:Oman|0\"\
: {\n \"acc_norm\": 0.17777777777777778,\n \"acc_norm_stderr\": 0.05763774795025094\n\
\ },\n \"community|acva:Palestine|0\": {\n \"acc_norm\": 0.24705882352941178,\n\
\ \"acc_norm_stderr\": 0.047058823529411785\n },\n \"community|acva:Qatar|0\"\
: {\n \"acc_norm\": 0.4222222222222222,\n \"acc_norm_stderr\": 0.07446027270295806\n\
\ },\n \"community|acva:Saudi_Arabia|0\": {\n \"acc_norm\": 0.3282051282051282,\n\
\ \"acc_norm_stderr\": 0.03371243782413707\n },\n \"community|acva:Somalia|0\"\
: {\n \"acc_norm\": 0.35555555555555557,\n \"acc_norm_stderr\": 0.07216392363431012\n\
\ },\n \"community|acva:Sudan|0\": {\n \"acc_norm\": 0.35555555555555557,\n\
\ \"acc_norm_stderr\": 0.07216392363431012\n },\n \"community|acva:Syria|0\"\
: {\n \"acc_norm\": 0.3333333333333333,\n \"acc_norm_stderr\": 0.07106690545187012\n\
\ },\n \"community|acva:Tunisia|0\": {\n \"acc_norm\": 0.3111111111111111,\n\
\ \"acc_norm_stderr\": 0.06979205927323111\n },\n \"community|acva:United_Arab_Emirates|0\"\
: {\n \"acc_norm\": 0.23529411764705882,\n \"acc_norm_stderr\": 0.04628210543937907\n\
\ },\n \"community|acva:Yemen|0\": {\n \"acc_norm\": 0.2,\n \
\ \"acc_norm_stderr\": 0.13333333333333333\n },\n \"community|acva:communication|0\"\
: {\n \"acc_norm\": 0.42857142857142855,\n \"acc_norm_stderr\": 0.025974025974025955\n\
\ },\n \"community|acva:computer_and_phone|0\": {\n \"acc_norm\": 0.45084745762711864,\n\
\ \"acc_norm_stderr\": 0.02901934773187137\n },\n \"community|acva:daily_life|0\"\
: {\n \"acc_norm\": 0.18694362017804153,\n \"acc_norm_stderr\": 0.021268948348414647\n\
\ },\n \"community|acva:entertainment|0\": {\n \"acc_norm\": 0.23389830508474577,\n\
\ \"acc_norm_stderr\": 0.024687839412166384\n },\n \"community|alghafa:mcq_exams_test_ar|0\"\
: {\n \"acc_norm\": 0.40933572710951527,\n \"acc_norm_stderr\": 0.020853203505482712\n\
\ },\n \"community|alghafa:meta_ar_dialects|0\": {\n \"acc_norm\":\
\ 0.43021316033364226,\n \"acc_norm_stderr\": 0.00674128334875823\n },\n\
\ \"community|alghafa:meta_ar_msa|0\": {\n \"acc_norm\": 0.47150837988826816,\n\
\ \"acc_norm_stderr\": 0.016695329746015796\n },\n \"community|alghafa:multiple_choice_facts_truefalse_balanced_task|0\"\
: {\n \"acc_norm\": 0.52,\n \"acc_norm_stderr\": 0.05807730170189531\n\
\ },\n \"community|alghafa:multiple_choice_grounded_statement_soqal_task|0\"\
: {\n \"acc_norm\": 0.6733333333333333,\n \"acc_norm_stderr\": 0.03842150156165228\n\
\ },\n \"community|alghafa:multiple_choice_grounded_statement_xglue_mlqa_task|0\"\
: {\n \"acc_norm\": 0.44666666666666666,\n \"acc_norm_stderr\": 0.04072790343023465\n\
\ },\n \"community|alghafa:multiple_choice_rating_sentiment_no_neutral_task|0\"\
: {\n \"acc_norm\": 0.8310193871169481,\n \"acc_norm_stderr\": 0.004191234365102777\n\
\ },\n \"community|alghafa:multiple_choice_rating_sentiment_task|0\": {\n\
\ \"acc_norm\": 0.5766472060050042,\n \"acc_norm_stderr\": 0.006381869832933108\n\
\ },\n \"community|alghafa:multiple_choice_sentiment_task|0\": {\n \
\ \"acc_norm\": 0.4174418604651163,\n \"acc_norm_stderr\": 0.011894048296224076\n\
\ },\n \"community|arabic_exams|0\": {\n \"acc_norm\": 0.5288640595903166,\n\
\ \"acc_norm_stderr\": 0.021560694703313493\n },\n \"community|arabic_mmlu:abstract_algebra|0\"\
: {\n \"acc_norm\": 0.39,\n \"acc_norm_stderr\": 0.04902071300001974\n\
\ },\n \"community|arabic_mmlu:anatomy|0\": {\n \"acc_norm\": 0.42962962962962964,\n\
\ \"acc_norm_stderr\": 0.042763494943765995\n },\n \"community|arabic_mmlu:astronomy|0\"\
: {\n \"acc_norm\": 0.6710526315789473,\n \"acc_norm_stderr\": 0.03823428969926604\n\
\ },\n \"community|arabic_mmlu:business_ethics|0\": {\n \"acc_norm\"\
: 0.63,\n \"acc_norm_stderr\": 0.048523658709391\n },\n \"community|arabic_mmlu:clinical_knowledge|0\"\
: {\n \"acc_norm\": 0.6339622641509434,\n \"acc_norm_stderr\": 0.029647813539365242\n\
\ },\n \"community|arabic_mmlu:college_biology|0\": {\n \"acc_norm\"\
: 0.5555555555555556,\n \"acc_norm_stderr\": 0.04155319955593146\n },\n\
\ \"community|arabic_mmlu:college_chemistry|0\": {\n \"acc_norm\": 0.42,\n\
\ \"acc_norm_stderr\": 0.04960449637488584\n },\n \"community|arabic_mmlu:college_computer_science|0\"\
: {\n \"acc_norm\": 0.45,\n \"acc_norm_stderr\": 0.05\n },\n \
\ \"community|arabic_mmlu:college_mathematics|0\": {\n \"acc_norm\": 0.43,\n\
\ \"acc_norm_stderr\": 0.04975698519562428\n },\n \"community|arabic_mmlu:college_medicine|0\"\
: {\n \"acc_norm\": 0.5375722543352601,\n \"acc_norm_stderr\": 0.03801685104524458\n\
\ },\n \"community|arabic_mmlu:college_physics|0\": {\n \"acc_norm\"\
: 0.4019607843137255,\n \"acc_norm_stderr\": 0.04878608714466995\n },\n\
\ \"community|arabic_mmlu:computer_security|0\": {\n \"acc_norm\": 0.55,\n\
\ \"acc_norm_stderr\": 0.05\n },\n \"community|arabic_mmlu:conceptual_physics|0\"\
: {\n \"acc_norm\": 0.6382978723404256,\n \"acc_norm_stderr\": 0.0314108219759624\n\
\ },\n \"community|arabic_mmlu:econometrics|0\": {\n \"acc_norm\":\
\ 0.4824561403508772,\n \"acc_norm_stderr\": 0.04700708033551038\n },\n\
\ \"community|arabic_mmlu:electrical_engineering|0\": {\n \"acc_norm\"\
: 0.5724137931034483,\n \"acc_norm_stderr\": 0.04122737111370332\n },\n\
\ \"community|arabic_mmlu:elementary_mathematics|0\": {\n \"acc_norm\"\
: 0.6746031746031746,\n \"acc_norm_stderr\": 0.024130158299762616\n },\n\
\ \"community|arabic_mmlu:formal_logic|0\": {\n \"acc_norm\": 0.5079365079365079,\n\
\ \"acc_norm_stderr\": 0.044715725362943486\n },\n \"community|arabic_mmlu:global_facts|0\"\
: {\n \"acc_norm\": 0.51,\n \"acc_norm_stderr\": 0.05024183937956912\n\
\ },\n \"community|arabic_mmlu:high_school_biology|0\": {\n \"acc_norm\"\
: 0.6903225806451613,\n \"acc_norm_stderr\": 0.026302774983517418\n },\n\
\ \"community|arabic_mmlu:high_school_chemistry|0\": {\n \"acc_norm\"\
: 0.5566502463054187,\n \"acc_norm_stderr\": 0.03495334582162934\n },\n\
\ \"community|arabic_mmlu:high_school_computer_science|0\": {\n \"acc_norm\"\
: 0.74,\n \"acc_norm_stderr\": 0.0440844002276808\n },\n \"community|arabic_mmlu:high_school_european_history|0\"\
: {\n \"acc_norm\": 0.2787878787878788,\n \"acc_norm_stderr\": 0.035014387062967806\n\
\ },\n \"community|arabic_mmlu:high_school_geography|0\": {\n \"acc_norm\"\
: 0.7727272727272727,\n \"acc_norm_stderr\": 0.029857515673386407\n },\n\
\ \"community|arabic_mmlu:high_school_government_and_politics|0\": {\n \
\ \"acc_norm\": 0.694300518134715,\n \"acc_norm_stderr\": 0.03324837939758159\n\
\ },\n \"community|arabic_mmlu:high_school_macroeconomics|0\": {\n \
\ \"acc_norm\": 0.6641025641025641,\n \"acc_norm_stderr\": 0.023946724741563976\n\
\ },\n \"community|arabic_mmlu:high_school_mathematics|0\": {\n \"\
acc_norm\": 0.4888888888888889,\n \"acc_norm_stderr\": 0.030478009819615823\n\
\ },\n \"community|arabic_mmlu:high_school_microeconomics|0\": {\n \
\ \"acc_norm\": 0.6932773109243697,\n \"acc_norm_stderr\": 0.02995382389188704\n\
\ },\n \"community|arabic_mmlu:high_school_physics|0\": {\n \"acc_norm\"\
: 0.4768211920529801,\n \"acc_norm_stderr\": 0.04078093859163084\n },\n\
\ \"community|arabic_mmlu:high_school_psychology|0\": {\n \"acc_norm\"\
: 0.6660550458715596,\n \"acc_norm_stderr\": 0.020220554196736407\n },\n\
\ \"community|arabic_mmlu:high_school_statistics|0\": {\n \"acc_norm\"\
: 0.5879629629629629,\n \"acc_norm_stderr\": 0.03356787758160831\n },\n\
\ \"community|arabic_mmlu:high_school_us_history|0\": {\n \"acc_norm\"\
: 0.29901960784313725,\n \"acc_norm_stderr\": 0.03213325717373616\n },\n\
\ \"community|arabic_mmlu:high_school_world_history|0\": {\n \"acc_norm\"\
: 0.3670886075949367,\n \"acc_norm_stderr\": 0.031376240725616185\n },\n\
\ \"community|arabic_mmlu:human_aging|0\": {\n \"acc_norm\": 0.5605381165919282,\n\
\ \"acc_norm_stderr\": 0.033310925110381785\n },\n \"community|arabic_mmlu:human_sexuality|0\"\
: {\n \"acc_norm\": 0.5954198473282443,\n \"acc_norm_stderr\": 0.043046937953806645\n\
\ },\n \"community|arabic_mmlu:international_law|0\": {\n \"acc_norm\"\
: 0.7851239669421488,\n \"acc_norm_stderr\": 0.037494924487096966\n },\n\
\ \"community|arabic_mmlu:jurisprudence|0\": {\n \"acc_norm\": 0.6388888888888888,\n\
\ \"acc_norm_stderr\": 0.04643454608906276\n },\n \"community|arabic_mmlu:logical_fallacies|0\"\
: {\n \"acc_norm\": 0.5214723926380368,\n \"acc_norm_stderr\": 0.03924746876751129\n\
\ },\n \"community|arabic_mmlu:machine_learning|0\": {\n \"acc_norm\"\
: 0.3482142857142857,\n \"acc_norm_stderr\": 0.045218299028335865\n },\n\
\ \"community|arabic_mmlu:management|0\": {\n \"acc_norm\": 0.6310679611650486,\n\
\ \"acc_norm_stderr\": 0.0477761518115674\n },\n \"community|arabic_mmlu:marketing|0\"\
: {\n \"acc_norm\": 0.7521367521367521,\n \"acc_norm_stderr\": 0.028286324075564397\n\
\ },\n \"community|arabic_mmlu:medical_genetics|0\": {\n \"acc_norm\"\
: 0.55,\n \"acc_norm_stderr\": 0.04999999999999999\n },\n \"community|arabic_mmlu:miscellaneous|0\"\
: {\n \"acc_norm\": 0.6564495530012772,\n \"acc_norm_stderr\": 0.016982145632652462\n\
\ },\n \"community|arabic_mmlu:moral_disputes|0\": {\n \"acc_norm\"\
: 0.6271676300578035,\n \"acc_norm_stderr\": 0.026033890613576288\n },\n\
\ \"community|arabic_mmlu:moral_scenarios|0\": {\n \"acc_norm\": 0.3564245810055866,\n\
\ \"acc_norm_stderr\": 0.01601823971051344\n },\n \"community|arabic_mmlu:nutrition|0\"\
: {\n \"acc_norm\": 0.6797385620915033,\n \"acc_norm_stderr\": 0.026716118380156847\n\
\ },\n \"community|arabic_mmlu:philosophy|0\": {\n \"acc_norm\": 0.6205787781350482,\n\
\ \"acc_norm_stderr\": 0.027559949802347824\n },\n \"community|arabic_mmlu:prehistory|0\"\
: {\n \"acc_norm\": 0.5925925925925926,\n \"acc_norm_stderr\": 0.027339546640662734\n\
\ },\n \"community|arabic_mmlu:professional_accounting|0\": {\n \"\
acc_norm\": 0.4326241134751773,\n \"acc_norm_stderr\": 0.02955545423677886\n\
\ },\n \"community|arabic_mmlu:professional_law|0\": {\n \"acc_norm\"\
: 0.35853976531942633,\n \"acc_norm_stderr\": 0.012248487319682748\n },\n\
\ \"community|arabic_mmlu:professional_medicine|0\": {\n \"acc_norm\"\
: 0.34191176470588236,\n \"acc_norm_stderr\": 0.028814722422254177\n },\n\
\ \"community|arabic_mmlu:professional_psychology|0\": {\n \"acc_norm\"\
: 0.5343137254901961,\n \"acc_norm_stderr\": 0.020180144843307296\n },\n\
\ \"community|arabic_mmlu:public_relations|0\": {\n \"acc_norm\": 0.6818181818181818,\n\
\ \"acc_norm_stderr\": 0.044612721759105085\n },\n \"community|arabic_mmlu:security_studies|0\"\
: {\n \"acc_norm\": 0.673469387755102,\n \"acc_norm_stderr\": 0.030021056238440317\n\
\ },\n \"community|arabic_mmlu:sociology|0\": {\n \"acc_norm\": 0.6766169154228856,\n\
\ \"acc_norm_stderr\": 0.033076159479790354\n },\n \"community|arabic_mmlu:us_foreign_policy|0\"\
: {\n \"acc_norm\": 0.79,\n \"acc_norm_stderr\": 0.040936018074033256\n\
\ },\n \"community|arabic_mmlu:virology|0\": {\n \"acc_norm\": 0.42771084337349397,\n\
\ \"acc_norm_stderr\": 0.038515976837185335\n },\n \"community|arabic_mmlu:world_religions|0\"\
: {\n \"acc_norm\": 0.672514619883041,\n \"acc_norm_stderr\": 0.035993357714560276\n\
\ },\n \"community|arc_challenge_okapi_ar|0\": {\n \"acc_norm\": 0.5189655172413793,\n\
\ \"acc_norm_stderr\": 0.01467626814124505\n },\n \"community|arc_easy_ar|0\"\
: {\n \"acc_norm\": 0.5088832487309645,\n \"acc_norm_stderr\": 0.010284178133743924\n\
\ },\n \"community|boolq_ar|0\": {\n \"acc_norm\": 0.7595092024539877,\n\
\ \"acc_norm_stderr\": 0.007486409366616893\n },\n \"community|copa_ext_ar|0\"\
: {\n \"acc_norm\": 0.5111111111111111,\n \"acc_norm_stderr\": 0.05298680599073449\n\
\ },\n \"community|hellaswag_okapi_ar|0\": {\n \"acc_norm\": 0.29484243812016137,\n\
\ \"acc_norm_stderr\": 0.004761605518155318\n },\n \"community|openbook_qa_ext_ar|0\"\
: {\n \"acc_norm\": 0.5131313131313131,\n \"acc_norm_stderr\": 0.022488304140334724\n\
\ },\n \"community|piqa_ar|0\": {\n \"acc_norm\": 0.6339334424440808,\n\
\ \"acc_norm_stderr\": 0.011254834793102051\n },\n \"community|race_ar|0\"\
: {\n \"acc_norm\": 0.46317711503347536,\n \"acc_norm_stderr\": 0.007103194520142282\n\
\ },\n \"community|sciq_ar|0\": {\n \"acc_norm\": 0.6040201005025125,\n\
\ \"acc_norm_stderr\": 0.015512045643684818\n },\n \"community|toxigen_ar|0\"\
: {\n \"acc_norm\": 0.4320855614973262,\n \"acc_norm_stderr\": 0.01620887578524445\n\
\ },\n \"lighteval|xstory_cloze:ar|0\": {\n \"acc\": 0.6644606221045665,\n\
\ \"acc_stderr\": 0.012151164438163903\n },\n \"community|acva:_average|0\"\
: {\n \"acc_norm\": 0.3957590653125476,\n \"acc_norm_stderr\": 0.04580004829561384\n\
\ },\n \"community|alghafa:_average|0\": {\n \"acc_norm\": 0.530685080102055,\n\
\ \"acc_norm_stderr\": 0.02266485286536655\n },\n \"community|arabic_mmlu:_average|0\"\
: {\n \"acc_norm\": 0.5608206756188224,\n \"acc_norm_stderr\": 0.035894357589353464\n\
\ }\n}\n```"
repo_url: https://huggingface.co/SicariusSicariiStuff/Qwen2.5-14B_Uncensored_Instruct
configs:
- config_name: community_acva_Algeria_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Algeria|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Algeria|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Ancient_Egypt_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Ancient_Egypt|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Ancient_Egypt|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arab_Empire_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arab_Empire|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arab_Empire|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Architecture_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Architecture|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Architecture|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Art_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Art|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Art|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Astronomy_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Astronomy|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Astronomy|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Calligraphy_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Calligraphy|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Calligraphy|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Ceremony_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Ceremony|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Ceremony|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Clothing_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Clothing|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Clothing|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Culture_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Culture|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Culture|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Food_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Food|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Food|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Funeral_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Funeral|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Funeral|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Geography_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Geography|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Geography|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_History_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_History|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_History|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Language_Origin_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Language_Origin|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Language_Origin|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Literature_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Literature|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Literature|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Math_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Math|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Math|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Medicine_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Medicine|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Medicine|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Music_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Music|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Music|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Ornament_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Ornament|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Ornament|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Philosophy_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Philosophy|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Philosophy|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Physics_and_Chemistry_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Physics_and_Chemistry|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Physics_and_Chemistry|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Arabic_Wedding_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Arabic_Wedding|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Wedding|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Bahrain_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Bahrain|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Bahrain|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Comoros_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Comoros|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Comoros|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Egypt_modern_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Egypt_modern|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Egypt_modern|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_InfluenceFromAncientEgypt_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:InfluenceFromAncientEgypt|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromAncientEgypt|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_InfluenceFromByzantium_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:InfluenceFromByzantium|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromByzantium|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_InfluenceFromChina_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:InfluenceFromChina|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromChina|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_InfluenceFromGreece_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:InfluenceFromGreece|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromGreece|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_InfluenceFromIslam_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:InfluenceFromIslam|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromIslam|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_InfluenceFromPersia_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:InfluenceFromPersia|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromPersia|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_InfluenceFromRome_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:InfluenceFromRome|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromRome|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Iraq_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Iraq|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Iraq|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Islam_Education_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Islam_Education|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Islam_Education|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Islam_branches_and_schools_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Islam_branches_and_schools|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Islam_branches_and_schools|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Islamic_law_system_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Islamic_law_system|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Islamic_law_system|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Jordan_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Jordan|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Jordan|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Kuwait_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Kuwait|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Kuwait|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Lebanon_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Lebanon|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Lebanon|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Libya_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Libya|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Libya|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Mauritania_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Mauritania|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Mauritania|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Mesopotamia_civilization_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Mesopotamia_civilization|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Mesopotamia_civilization|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Morocco_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Morocco|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Morocco|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Oman_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Oman|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Oman|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Palestine_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Palestine|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Palestine|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Qatar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Qatar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Qatar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Saudi_Arabia_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Saudi_Arabia|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Saudi_Arabia|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Somalia_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Somalia|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Somalia|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Sudan_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Sudan|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Sudan|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Syria_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Syria|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Syria|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Tunisia_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Tunisia|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Tunisia|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_United_Arab_Emirates_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:United_Arab_Emirates|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:United_Arab_Emirates|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_Yemen_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:Yemen|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:Yemen|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_communication_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:communication|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:communication|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_computer_and_phone_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:computer_and_phone|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:computer_and_phone|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_daily_life_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:daily_life|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:daily_life|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_acva_entertainment_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|acva:entertainment|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|acva:entertainment|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_alghafa_mcq_exams_test_ar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|alghafa:mcq_exams_test_ar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|alghafa:mcq_exams_test_ar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_alghafa_meta_ar_dialects_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|alghafa:meta_ar_dialects|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|alghafa:meta_ar_dialects|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_alghafa_meta_ar_msa_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|alghafa:meta_ar_msa|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|alghafa:meta_ar_msa|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_alghafa_multiple_choice_facts_truefalse_balanced_task_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|alghafa:multiple_choice_facts_truefalse_balanced_task|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|alghafa:multiple_choice_facts_truefalse_balanced_task|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_alghafa_multiple_choice_grounded_statement_soqal_task_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|alghafa:multiple_choice_grounded_statement_soqal_task|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|alghafa:multiple_choice_grounded_statement_soqal_task|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|alghafa:multiple_choice_grounded_statement_xglue_mlqa_task|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|alghafa:multiple_choice_grounded_statement_xglue_mlqa_task|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_alghafa_multiple_choice_rating_sentiment_no_neutral_task_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|alghafa:multiple_choice_rating_sentiment_no_neutral_task|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|alghafa:multiple_choice_rating_sentiment_no_neutral_task|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_alghafa_multiple_choice_rating_sentiment_task_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|alghafa:multiple_choice_rating_sentiment_task|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|alghafa:multiple_choice_rating_sentiment_task|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_alghafa_multiple_choice_sentiment_task_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|alghafa:multiple_choice_sentiment_task|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|alghafa:multiple_choice_sentiment_task|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_exams_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_exams|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_exams|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_abstract_algebra_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:abstract_algebra|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:abstract_algebra|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_anatomy_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:anatomy|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:anatomy|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_astronomy_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:astronomy|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:astronomy|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_business_ethics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:business_ethics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:business_ethics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_clinical_knowledge_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:clinical_knowledge|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:clinical_knowledge|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_college_biology_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:college_biology|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:college_biology|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_college_chemistry_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:college_chemistry|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:college_chemistry|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_college_computer_science_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:college_computer_science|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:college_computer_science|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_college_mathematics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:college_mathematics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:college_mathematics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_college_medicine_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:college_medicine|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:college_medicine|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_college_physics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:college_physics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:college_physics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_computer_security_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:computer_security|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:computer_security|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_conceptual_physics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:conceptual_physics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:conceptual_physics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_econometrics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:econometrics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:econometrics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_electrical_engineering_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:electrical_engineering|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:electrical_engineering|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_elementary_mathematics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:elementary_mathematics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:elementary_mathematics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_formal_logic_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:formal_logic|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:formal_logic|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_global_facts_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:global_facts|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:global_facts|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_biology_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_biology|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_biology|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_chemistry_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_chemistry|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_chemistry|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_computer_science_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_computer_science|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_computer_science|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_european_history_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_european_history|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_european_history|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_geography_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_geography|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_geography|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_government_and_politics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_government_and_politics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_government_and_politics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_macroeconomics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_macroeconomics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_macroeconomics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_mathematics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_mathematics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_mathematics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_microeconomics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_microeconomics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_microeconomics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_physics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_physics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_physics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_psychology_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_psychology|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_psychology|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_statistics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_statistics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_statistics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_us_history_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_us_history|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_us_history|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_high_school_world_history_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:high_school_world_history|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_world_history|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_human_aging_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:human_aging|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:human_aging|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_human_sexuality_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:human_sexuality|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:human_sexuality|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_international_law_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:international_law|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:international_law|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_jurisprudence_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:jurisprudence|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:jurisprudence|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_logical_fallacies_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:logical_fallacies|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:logical_fallacies|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_machine_learning_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:machine_learning|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:machine_learning|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_management_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:management|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:management|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_marketing_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:marketing|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:marketing|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_medical_genetics_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:medical_genetics|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:medical_genetics|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_miscellaneous_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:miscellaneous|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:miscellaneous|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_moral_disputes_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:moral_disputes|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:moral_disputes|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_moral_scenarios_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:moral_scenarios|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:moral_scenarios|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_nutrition_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:nutrition|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:nutrition|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_philosophy_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:philosophy|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:philosophy|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_prehistory_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:prehistory|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:prehistory|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_professional_accounting_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:professional_accounting|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:professional_accounting|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_professional_law_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:professional_law|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:professional_law|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_professional_medicine_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:professional_medicine|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:professional_medicine|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_professional_psychology_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:professional_psychology|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:professional_psychology|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_public_relations_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:public_relations|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:public_relations|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_security_studies_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:security_studies|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:security_studies|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_sociology_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:sociology|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:sociology|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_us_foreign_policy_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:us_foreign_policy|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:us_foreign_policy|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_virology_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:virology|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:virology|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arabic_mmlu_world_religions_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arabic_mmlu:world_religions|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:world_religions|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arc_challenge_okapi_ar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arc_challenge_okapi_ar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arc_challenge_okapi_ar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_arc_easy_ar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|arc_easy_ar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|arc_easy_ar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_boolq_ar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|boolq_ar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|boolq_ar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_copa_ext_ar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|copa_ext_ar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|copa_ext_ar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_hellaswag_okapi_ar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|hellaswag_okapi_ar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|hellaswag_okapi_ar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_openbook_qa_ext_ar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|openbook_qa_ext_ar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|openbook_qa_ext_ar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_piqa_ar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|piqa_ar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|piqa_ar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_race_ar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|race_ar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|race_ar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_sciq_ar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|sciq_ar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|sciq_ar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: community_toxigen_ar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_community|toxigen_ar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_community|toxigen_ar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: lighteval_xstory_cloze_ar_0
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- '**/details_lighteval|xstory_cloze:ar|0_2024-09-22T05-29-20.135186.parquet'
- split: latest
path:
- '**/details_lighteval|xstory_cloze:ar|0_2024-09-22T05-29-20.135186.parquet'
- config_name: results
data_files:
- split: 2024_09_22T05_29_20.135186
path:
- results_2024-09-22T05-29-20.135186.parquet
- split: latest
path:
- results_2024-09-22T05-29-20.135186.parquet
---
# Dataset Card for Evaluation run of SicariusSicariiStuff/Qwen2.5-14B_Uncensored_Instruct
<!-- Provide a quick summary of the dataset. -->
Dataset automatically created during the evaluation run of model [SicariusSicariiStuff/Qwen2.5-14B_Uncensored_Instruct](https://huggingface.co/SicariusSicariiStuff/Qwen2.5-14B_Uncensored_Instruct).
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional configuration "results" store all the aggregated results of the run.
To load the details from a run, you can for instance do the following:
```python
from datasets import load_dataset
data = load_dataset("OALL/details_SicariusSicariiStuff__Qwen2.5-14B_Uncensored_Instruct",
"lighteval_xstory_cloze_ar_0",
split="train")
```
## Latest results
These are the [latest results from run 2024-09-22T05:29:20.135186](https://huggingface.co/datasets/OALL/details_SicariusSicariiStuff__Qwen2.5-14B_Uncensored_Instruct/blob/main/results_2024-09-22T05-29-20.135186.json)(note that their might be results for other tasks in the repos if successive evals didn't cover the same tasks. You find each in the results and the "latest" split for each eval):
```python
{
"all": {
"acc_norm": 0.4849295787346353,
"acc_norm_stderr": 0.037708800564913825,
"acc": 0.6644606221045665,
"acc_stderr": 0.012151164438163903
},
"community|acva:Algeria|0": {
"acc_norm": 0.5230769230769231,
"acc_norm_stderr": 0.0358596530894741
},
"community|acva:Ancient_Egypt|0": {
"acc_norm": 0.050793650793650794,
"acc_norm_stderr": 0.01239139518482262
},
"community|acva:Arab_Empire|0": {
"acc_norm": 0.30943396226415093,
"acc_norm_stderr": 0.028450154794118627
},
"community|acva:Arabic_Architecture|0": {
"acc_norm": 0.4564102564102564,
"acc_norm_stderr": 0.035761230969912135
},
"community|acva:Arabic_Art|0": {
"acc_norm": 0.3641025641025641,
"acc_norm_stderr": 0.03454653867786389
},
"community|acva:Arabic_Astronomy|0": {
"acc_norm": 0.4666666666666667,
"acc_norm_stderr": 0.03581804596782233
},
"community|acva:Arabic_Calligraphy|0": {
"acc_norm": 0.47843137254901963,
"acc_norm_stderr": 0.0313435870640056
},
"community|acva:Arabic_Ceremony|0": {
"acc_norm": 0.518918918918919,
"acc_norm_stderr": 0.036834092970087065
},
"community|acva:Arabic_Clothing|0": {
"acc_norm": 0.5128205128205128,
"acc_norm_stderr": 0.03588610523192215
},
"community|acva:Arabic_Culture|0": {
"acc_norm": 0.23076923076923078,
"acc_norm_stderr": 0.0302493752938313
},
"community|acva:Arabic_Food|0": {
"acc_norm": 0.441025641025641,
"acc_norm_stderr": 0.0356473293185358
},
"community|acva:Arabic_Funeral|0": {
"acc_norm": 0.4,
"acc_norm_stderr": 0.050529115263991134
},
"community|acva:Arabic_Geography|0": {
"acc_norm": 0.6206896551724138,
"acc_norm_stderr": 0.040434618619167466
},
"community|acva:Arabic_History|0": {
"acc_norm": 0.30256410256410254,
"acc_norm_stderr": 0.03298070870085619
},
"community|acva:Arabic_Language_Origin|0": {
"acc_norm": 0.5473684210526316,
"acc_norm_stderr": 0.051339113773544845
},
"community|acva:Arabic_Literature|0": {
"acc_norm": 0.4689655172413793,
"acc_norm_stderr": 0.04158632762097828
},
"community|acva:Arabic_Math|0": {
"acc_norm": 0.30256410256410254,
"acc_norm_stderr": 0.03298070870085618
},
"community|acva:Arabic_Medicine|0": {
"acc_norm": 0.46206896551724136,
"acc_norm_stderr": 0.041546596717075474
},
"community|acva:Arabic_Music|0": {
"acc_norm": 0.23741007194244604,
"acc_norm_stderr": 0.036220593237998276
},
"community|acva:Arabic_Ornament|0": {
"acc_norm": 0.4717948717948718,
"acc_norm_stderr": 0.035840746749208334
},
"community|acva:Arabic_Philosophy|0": {
"acc_norm": 0.5793103448275863,
"acc_norm_stderr": 0.0411391498118926
},
"community|acva:Arabic_Physics_and_Chemistry|0": {
"acc_norm": 0.5333333333333333,
"acc_norm_stderr": 0.03581804596782232
},
"community|acva:Arabic_Wedding|0": {
"acc_norm": 0.41025641025641024,
"acc_norm_stderr": 0.03531493712326671
},
"community|acva:Bahrain|0": {
"acc_norm": 0.3111111111111111,
"acc_norm_stderr": 0.06979205927323111
},
"community|acva:Comoros|0": {
"acc_norm": 0.37777777777777777,
"acc_norm_stderr": 0.07309112127323451
},
"community|acva:Egypt_modern|0": {
"acc_norm": 0.3157894736842105,
"acc_norm_stderr": 0.04794350420740798
},
"community|acva:InfluenceFromAncientEgypt|0": {
"acc_norm": 0.6051282051282051,
"acc_norm_stderr": 0.03509545602262038
},
"community|acva:InfluenceFromByzantium|0": {
"acc_norm": 0.7172413793103448,
"acc_norm_stderr": 0.03752833958003337
},
"community|acva:InfluenceFromChina|0": {
"acc_norm": 0.26666666666666666,
"acc_norm_stderr": 0.0317493043641267
},
"community|acva:InfluenceFromGreece|0": {
"acc_norm": 0.6307692307692307,
"acc_norm_stderr": 0.034648411418637566
},
"community|acva:InfluenceFromIslam|0": {
"acc_norm": 0.296551724137931,
"acc_norm_stderr": 0.03806142687309993
},
"community|acva:InfluenceFromPersia|0": {
"acc_norm": 0.6971428571428572,
"acc_norm_stderr": 0.03483414676585986
},
"community|acva:InfluenceFromRome|0": {
"acc_norm": 0.5743589743589743,
"acc_norm_stderr": 0.03549871080367708
},
"community|acva:Iraq|0": {
"acc_norm": 0.5058823529411764,
"acc_norm_stderr": 0.05455069703232772
},
"community|acva:Islam_Education|0": {
"acc_norm": 0.4512820512820513,
"acc_norm_stderr": 0.03572709860318392
},
"community|acva:Islam_branches_and_schools|0": {
"acc_norm": 0.4342857142857143,
"acc_norm_stderr": 0.037576101528126626
},
"community|acva:Islamic_law_system|0": {
"acc_norm": 0.4256410256410256,
"acc_norm_stderr": 0.035498710803677086
},
"community|acva:Jordan|0": {
"acc_norm": 0.3333333333333333,
"acc_norm_stderr": 0.07106690545187012
},
"community|acva:Kuwait|0": {
"acc_norm": 0.26666666666666666,
"acc_norm_stderr": 0.06666666666666667
},
"community|acva:Lebanon|0": {
"acc_norm": 0.17777777777777778,
"acc_norm_stderr": 0.05763774795025094
},
"community|acva:Libya|0": {
"acc_norm": 0.4444444444444444,
"acc_norm_stderr": 0.07491109582924914
},
"community|acva:Mauritania|0": {
"acc_norm": 0.4222222222222222,
"acc_norm_stderr": 0.07446027270295805
},
"community|acva:Mesopotamia_civilization|0": {
"acc_norm": 0.5225806451612903,
"acc_norm_stderr": 0.0402500394824441
},
"community|acva:Morocco|0": {
"acc_norm": 0.2222222222222222,
"acc_norm_stderr": 0.06267511942419628
},
"community|acva:Oman|0": {
"acc_norm": 0.17777777777777778,
"acc_norm_stderr": 0.05763774795025094
},
"community|acva:Palestine|0": {
"acc_norm": 0.24705882352941178,
"acc_norm_stderr": 0.047058823529411785
},
"community|acva:Qatar|0": {
"acc_norm": 0.4222222222222222,
"acc_norm_stderr": 0.07446027270295806
},
"community|acva:Saudi_Arabia|0": {
"acc_norm": 0.3282051282051282,
"acc_norm_stderr": 0.03371243782413707
},
"community|acva:Somalia|0": {
"acc_norm": 0.35555555555555557,
"acc_norm_stderr": 0.07216392363431012
},
"community|acva:Sudan|0": {
"acc_norm": 0.35555555555555557,
"acc_norm_stderr": 0.07216392363431012
},
"community|acva:Syria|0": {
"acc_norm": 0.3333333333333333,
"acc_norm_stderr": 0.07106690545187012
},
"community|acva:Tunisia|0": {
"acc_norm": 0.3111111111111111,
"acc_norm_stderr": 0.06979205927323111
},
"community|acva:United_Arab_Emirates|0": {
"acc_norm": 0.23529411764705882,
"acc_norm_stderr": 0.04628210543937907
},
"community|acva:Yemen|0": {
"acc_norm": 0.2,
"acc_norm_stderr": 0.13333333333333333
},
"community|acva:communication|0": {
"acc_norm": 0.42857142857142855,
"acc_norm_stderr": 0.025974025974025955
},
"community|acva:computer_and_phone|0": {
"acc_norm": 0.45084745762711864,
"acc_norm_stderr": 0.02901934773187137
},
"community|acva:daily_life|0": {
"acc_norm": 0.18694362017804153,
"acc_norm_stderr": 0.021268948348414647
},
"community|acva:entertainment|0": {
"acc_norm": 0.23389830508474577,
"acc_norm_stderr": 0.024687839412166384
},
"community|alghafa:mcq_exams_test_ar|0": {
"acc_norm": 0.40933572710951527,
"acc_norm_stderr": 0.020853203505482712
},
"community|alghafa:meta_ar_dialects|0": {
"acc_norm": 0.43021316033364226,
"acc_norm_stderr": 0.00674128334875823
},
"community|alghafa:meta_ar_msa|0": {
"acc_norm": 0.47150837988826816,
"acc_norm_stderr": 0.016695329746015796
},
"community|alghafa:multiple_choice_facts_truefalse_balanced_task|0": {
"acc_norm": 0.52,
"acc_norm_stderr": 0.05807730170189531
},
"community|alghafa:multiple_choice_grounded_statement_soqal_task|0": {
"acc_norm": 0.6733333333333333,
"acc_norm_stderr": 0.03842150156165228
},
"community|alghafa:multiple_choice_grounded_statement_xglue_mlqa_task|0": {
"acc_norm": 0.44666666666666666,
"acc_norm_stderr": 0.04072790343023465
},
"community|alghafa:multiple_choice_rating_sentiment_no_neutral_task|0": {
"acc_norm": 0.8310193871169481,
"acc_norm_stderr": 0.004191234365102777
},
"community|alghafa:multiple_choice_rating_sentiment_task|0": {
"acc_norm": 0.5766472060050042,
"acc_norm_stderr": 0.006381869832933108
},
"community|alghafa:multiple_choice_sentiment_task|0": {
"acc_norm": 0.4174418604651163,
"acc_norm_stderr": 0.011894048296224076
},
"community|arabic_exams|0": {
"acc_norm": 0.5288640595903166,
"acc_norm_stderr": 0.021560694703313493
},
"community|arabic_mmlu:abstract_algebra|0": {
"acc_norm": 0.39,
"acc_norm_stderr": 0.04902071300001974
},
"community|arabic_mmlu:anatomy|0": {
"acc_norm": 0.42962962962962964,
"acc_norm_stderr": 0.042763494943765995
},
"community|arabic_mmlu:astronomy|0": {
"acc_norm": 0.6710526315789473,
"acc_norm_stderr": 0.03823428969926604
},
"community|arabic_mmlu:business_ethics|0": {
"acc_norm": 0.63,
"acc_norm_stderr": 0.048523658709391
},
"community|arabic_mmlu:clinical_knowledge|0": {
"acc_norm": 0.6339622641509434,
"acc_norm_stderr": 0.029647813539365242
},
"community|arabic_mmlu:college_biology|0": {
"acc_norm": 0.5555555555555556,
"acc_norm_stderr": 0.04155319955593146
},
"community|arabic_mmlu:college_chemistry|0": {
"acc_norm": 0.42,
"acc_norm_stderr": 0.04960449637488584
},
"community|arabic_mmlu:college_computer_science|0": {
"acc_norm": 0.45,
"acc_norm_stderr": 0.05
},
"community|arabic_mmlu:college_mathematics|0": {
"acc_norm": 0.43,
"acc_norm_stderr": 0.04975698519562428
},
"community|arabic_mmlu:college_medicine|0": {
"acc_norm": 0.5375722543352601,
"acc_norm_stderr": 0.03801685104524458
},
"community|arabic_mmlu:college_physics|0": {
"acc_norm": 0.4019607843137255,
"acc_norm_stderr": 0.04878608714466995
},
"community|arabic_mmlu:computer_security|0": {
"acc_norm": 0.55,
"acc_norm_stderr": 0.05
},
"community|arabic_mmlu:conceptual_physics|0": {
"acc_norm": 0.6382978723404256,
"acc_norm_stderr": 0.0314108219759624
},
"community|arabic_mmlu:econometrics|0": {
"acc_norm": 0.4824561403508772,
"acc_norm_stderr": 0.04700708033551038
},
"community|arabic_mmlu:electrical_engineering|0": {
"acc_norm": 0.5724137931034483,
"acc_norm_stderr": 0.04122737111370332
},
"community|arabic_mmlu:elementary_mathematics|0": {
"acc_norm": 0.6746031746031746,
"acc_norm_stderr": 0.024130158299762616
},
"community|arabic_mmlu:formal_logic|0": {
"acc_norm": 0.5079365079365079,
"acc_norm_stderr": 0.044715725362943486
},
"community|arabic_mmlu:global_facts|0": {
"acc_norm": 0.51,
"acc_norm_stderr": 0.05024183937956912
},
"community|arabic_mmlu:high_school_biology|0": {
"acc_norm": 0.6903225806451613,
"acc_norm_stderr": 0.026302774983517418
},
"community|arabic_mmlu:high_school_chemistry|0": {
"acc_norm": 0.5566502463054187,
"acc_norm_stderr": 0.03495334582162934
},
"community|arabic_mmlu:high_school_computer_science|0": {
"acc_norm": 0.74,
"acc_norm_stderr": 0.0440844002276808
},
"community|arabic_mmlu:high_school_european_history|0": {
"acc_norm": 0.2787878787878788,
"acc_norm_stderr": 0.035014387062967806
},
"community|arabic_mmlu:high_school_geography|0": {
"acc_norm": 0.7727272727272727,
"acc_norm_stderr": 0.029857515673386407
},
"community|arabic_mmlu:high_school_government_and_politics|0": {
"acc_norm": 0.694300518134715,
"acc_norm_stderr": 0.03324837939758159
},
"community|arabic_mmlu:high_school_macroeconomics|0": {
"acc_norm": 0.6641025641025641,
"acc_norm_stderr": 0.023946724741563976
},
"community|arabic_mmlu:high_school_mathematics|0": {
"acc_norm": 0.4888888888888889,
"acc_norm_stderr": 0.030478009819615823
},
"community|arabic_mmlu:high_school_microeconomics|0": {
"acc_norm": 0.6932773109243697,
"acc_norm_stderr": 0.02995382389188704
},
"community|arabic_mmlu:high_school_physics|0": {
"acc_norm": 0.4768211920529801,
"acc_norm_stderr": 0.04078093859163084
},
"community|arabic_mmlu:high_school_psychology|0": {
"acc_norm": 0.6660550458715596,
"acc_norm_stderr": 0.020220554196736407
},
"community|arabic_mmlu:high_school_statistics|0": {
"acc_norm": 0.5879629629629629,
"acc_norm_stderr": 0.03356787758160831
},
"community|arabic_mmlu:high_school_us_history|0": {
"acc_norm": 0.29901960784313725,
"acc_norm_stderr": 0.03213325717373616
},
"community|arabic_mmlu:high_school_world_history|0": {
"acc_norm": 0.3670886075949367,
"acc_norm_stderr": 0.031376240725616185
},
"community|arabic_mmlu:human_aging|0": {
"acc_norm": 0.5605381165919282,
"acc_norm_stderr": 0.033310925110381785
},
"community|arabic_mmlu:human_sexuality|0": {
"acc_norm": 0.5954198473282443,
"acc_norm_stderr": 0.043046937953806645
},
"community|arabic_mmlu:international_law|0": {
"acc_norm": 0.7851239669421488,
"acc_norm_stderr": 0.037494924487096966
},
"community|arabic_mmlu:jurisprudence|0": {
"acc_norm": 0.6388888888888888,
"acc_norm_stderr": 0.04643454608906276
},
"community|arabic_mmlu:logical_fallacies|0": {
"acc_norm": 0.5214723926380368,
"acc_norm_stderr": 0.03924746876751129
},
"community|arabic_mmlu:machine_learning|0": {
"acc_norm": 0.3482142857142857,
"acc_norm_stderr": 0.045218299028335865
},
"community|arabic_mmlu:management|0": {
"acc_norm": 0.6310679611650486,
"acc_norm_stderr": 0.0477761518115674
},
"community|arabic_mmlu:marketing|0": {
"acc_norm": 0.7521367521367521,
"acc_norm_stderr": 0.028286324075564397
},
"community|arabic_mmlu:medical_genetics|0": {
"acc_norm": 0.55,
"acc_norm_stderr": 0.04999999999999999
},
"community|arabic_mmlu:miscellaneous|0": {
"acc_norm": 0.6564495530012772,
"acc_norm_stderr": 0.016982145632652462
},
"community|arabic_mmlu:moral_disputes|0": {
"acc_norm": 0.6271676300578035,
"acc_norm_stderr": 0.026033890613576288
},
"community|arabic_mmlu:moral_scenarios|0": {
"acc_norm": 0.3564245810055866,
"acc_norm_stderr": 0.01601823971051344
},
"community|arabic_mmlu:nutrition|0": {
"acc_norm": 0.6797385620915033,
"acc_norm_stderr": 0.026716118380156847
},
"community|arabic_mmlu:philosophy|0": {
"acc_norm": 0.6205787781350482,
"acc_norm_stderr": 0.027559949802347824
},
"community|arabic_mmlu:prehistory|0": {
"acc_norm": 0.5925925925925926,
"acc_norm_stderr": 0.027339546640662734
},
"community|arabic_mmlu:professional_accounting|0": {
"acc_norm": 0.4326241134751773,
"acc_norm_stderr": 0.02955545423677886
},
"community|arabic_mmlu:professional_law|0": {
"acc_norm": 0.35853976531942633,
"acc_norm_stderr": 0.012248487319682748
},
"community|arabic_mmlu:professional_medicine|0": {
"acc_norm": 0.34191176470588236,
"acc_norm_stderr": 0.028814722422254177
},
"community|arabic_mmlu:professional_psychology|0": {
"acc_norm": 0.5343137254901961,
"acc_norm_stderr": 0.020180144843307296
},
"community|arabic_mmlu:public_relations|0": {
"acc_norm": 0.6818181818181818,
"acc_norm_stderr": 0.044612721759105085
},
"community|arabic_mmlu:security_studies|0": {
"acc_norm": 0.673469387755102,
"acc_norm_stderr": 0.030021056238440317
},
"community|arabic_mmlu:sociology|0": {
"acc_norm": 0.6766169154228856,
"acc_norm_stderr": 0.033076159479790354
},
"community|arabic_mmlu:us_foreign_policy|0": {
"acc_norm": 0.79,
"acc_norm_stderr": 0.040936018074033256
},
"community|arabic_mmlu:virology|0": {
"acc_norm": 0.42771084337349397,
"acc_norm_stderr": 0.038515976837185335
},
"community|arabic_mmlu:world_religions|0": {
"acc_norm": 0.672514619883041,
"acc_norm_stderr": 0.035993357714560276
},
"community|arc_challenge_okapi_ar|0": {
"acc_norm": 0.5189655172413793,
"acc_norm_stderr": 0.01467626814124505
},
"community|arc_easy_ar|0": {
"acc_norm": 0.5088832487309645,
"acc_norm_stderr": 0.010284178133743924
},
"community|boolq_ar|0": {
"acc_norm": 0.7595092024539877,
"acc_norm_stderr": 0.007486409366616893
},
"community|copa_ext_ar|0": {
"acc_norm": 0.5111111111111111,
"acc_norm_stderr": 0.05298680599073449
},
"community|hellaswag_okapi_ar|0": {
"acc_norm": 0.29484243812016137,
"acc_norm_stderr": 0.004761605518155318
},
"community|openbook_qa_ext_ar|0": {
"acc_norm": 0.5131313131313131,
"acc_norm_stderr": 0.022488304140334724
},
"community|piqa_ar|0": {
"acc_norm": 0.6339334424440808,
"acc_norm_stderr": 0.011254834793102051
},
"community|race_ar|0": {
"acc_norm": 0.46317711503347536,
"acc_norm_stderr": 0.007103194520142282
},
"community|sciq_ar|0": {
"acc_norm": 0.6040201005025125,
"acc_norm_stderr": 0.015512045643684818
},
"community|toxigen_ar|0": {
"acc_norm": 0.4320855614973262,
"acc_norm_stderr": 0.01620887578524445
},
"lighteval|xstory_cloze:ar|0": {
"acc": 0.6644606221045665,
"acc_stderr": 0.012151164438163903
},
"community|acva:_average|0": {
"acc_norm": 0.3957590653125476,
"acc_norm_stderr": 0.04580004829561384
},
"community|alghafa:_average|0": {
"acc_norm": 0.530685080102055,
"acc_norm_stderr": 0.02266485286536655
},
"community|arabic_mmlu:_average|0": {
"acc_norm": 0.5608206756188224,
"acc_norm_stderr": 0.035894357589353464
}
}
```
## Dataset Details
### Dataset Description
<!-- Provide a longer summary of what this dataset is. -->
- **Curated by:** [More Information Needed]
- **Funded by [optional]:** [More Information Needed]
- **Shared by [optional]:** [More Information Needed]
- **Language(s) (NLP):** [More Information Needed]
- **License:** [More Information Needed]
### Dataset Sources [optional]
<!-- Provide the basic links for the dataset. -->
- **Repository:** [More Information Needed]
- **Paper [optional]:** [More Information Needed]
- **Demo [optional]:** [More Information Needed]
## Uses
<!-- Address questions around how the dataset is intended to be used. -->
### Direct Use
<!-- This section describes suitable use cases for the dataset. -->
[More Information Needed]
### Out-of-Scope Use
<!-- This section addresses misuse, malicious use, and uses that the dataset will not work well for. -->
[More Information Needed]
## Dataset Structure
<!-- This section provides a description of the dataset fields, and additional information about the dataset structure such as criteria used to create the splits, relationships between data points, etc. -->
[More Information Needed]
## Dataset Creation
### Curation Rationale
<!-- Motivation for the creation of this dataset. -->
[More Information Needed]
### Source Data
<!-- This section describes the source data (e.g. news text and headlines, social media posts, translated sentences, ...). -->
#### Data Collection and Processing
<!-- This section describes the data collection and processing process such as data selection criteria, filtering and normalization methods, tools and libraries used, etc. -->
[More Information Needed]
#### Who are the source data producers?
<!-- This section describes the people or systems who originally created the data. It should also include self-reported demographic or identity information for the source data creators if this information is available. -->
[More Information Needed]
### Annotations [optional]
<!-- If the dataset contains annotations which are not part of the initial data collection, use this section to describe them. -->
#### Annotation process
<!-- This section describes the annotation process such as annotation tools used in the process, the amount of data annotated, annotation guidelines provided to the annotators, interannotator statistics, annotation validation, etc. -->
[More Information Needed]
#### Who are the annotators?
<!-- This section describes the people or systems who created the annotations. -->
[More Information Needed]
#### Personal and Sensitive Information
<!-- State whether the dataset contains data that might be considered personal, sensitive, or private (e.g., data that reveals addresses, uniquely identifiable names or aliases, racial or ethnic origins, sexual orientations, religious beliefs, political opinions, financial or health data, etc.). If efforts were made to anonymize the data, describe the anonymization process. -->
[More Information Needed]
## Bias, Risks, and Limitations
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
[More Information Needed]
### Recommendations
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
Users should be made aware of the risks, biases and limitations of the dataset. More information needed for further recommendations.
## Citation [optional]
<!-- If there is a paper or blog post introducing the dataset, the APA and Bibtex information for that should go in this section. -->
**BibTeX:**
[More Information Needed]
**APA:**
[More Information Needed]
## Glossary [optional]
<!-- If relevant, include terms and calculations in this section that can help readers understand the dataset or dataset card. -->
[More Information Needed]
## More Information [optional]
[More Information Needed]
## Dataset Card Authors [optional]
[More Information Needed]
## Dataset Card Contact
[More Information Needed]
提供机构：
OALL搜集汇总
数据集介绍
构建方式
在自然语言处理模型的评估体系中，该数据集是专为评测SicariusSicariiStuff/Qwen2.5-14B_Uncensored_Instruct模型性能而自动生成的产物。数据集由136个独立配置组成，每个配置对应一个被评估的具体任务。整个数据集源自单次运行，每次运行的结果被存储为相应配置下的特定分割（split），分割的命名采用运行时间戳以标识其唯一性。其中，“train”分割始终指向最新一次的评估结果。此外，数据集还包含一个名为“results”的额外配置，用于汇总所有运行的综合指标。
特点
该数据集最显著的特征在于其精细化的任务划分与动态更新的结果管理机制。136个配置涵盖了从阿拉伯文化知识（如阿拉伯艺术、历史、语言起源）到多领域学术测试（如高中物理、医学遗传学、国际法）的广阔评估范围，展现了模型在跨领域知识上的表现。每个任务配置下的分割以时间戳命名，确保了评估历史轨迹的可追溯性，而“train”分割动态指向最新结果，则便于用户直接获取模型的最新性能快照。这种设计兼顾了评估的全面性与时效性。
使用方法
使用该数据集时，用户可通过HuggingFace的datasets库便捷地加载所需任务的评估细节。具体而言，调用load_dataset函数并指定数据集名称、目标任务配置（如“lighteval_xstory_cloze_ar_0”）以及所需的分割（如“train”），即可获取对应任务的详细评估数据。例如，执行代码`data = load_dataset("OALL/details_SicariusSicariiStuff__Qwen2.5-14B_Uncensored_Instruct", "lighteval_xstory_cloze_ar_0", split="train")`，即可加载该任务的最新评估结果。这种接口设计大幅降低了研究者获取模型性能数据的门槛。
背景与挑战
背景概述
该数据集由Open Arabic LLM Leaderboard（OALL）于2024年创建，旨在系统评估SicariusSicariiStuff/Qwen2.5-14B_Uncensored_Instruct模型在阿拉伯语自然语言处理任务上的综合表现。作为阿拉伯语大语言模型评测体系的重要组成部分，该数据集覆盖了136个多样化配置，涵盖从阿拉伯文化知识到多学科考试（如阿拉伯语MMLU）的广泛评测场景。其核心研究问题聚焦于探究未经审查的阿拉伯语模型在文化敏感性与学术严谨性之间的平衡能力，为阿拉伯语NLP领域提供了首个细粒度的模型性能基准。该数据集通过自动化的评估流水线生成，记录了2024年9月22日的最新运行结果，其发布对推动低资源语言模型的透明化评测具有里程碑意义。
当前挑战
该数据集面临的核心挑战在于解决阿拉伯语大模型评测中的文化适配性与领域覆盖完整性难题。首先，阿拉伯语作为一种形态丰富的语言，其方言变体（如埃及、黎凡特方言）与现代标准阿拉伯语之间的语义鸿沟，导致传统评测指标（如acc_norm）难以准确反映模型在真实场景中的表现。其次，构建过程中需要平衡136个任务配置的标注质量与覆盖广度，例如acva子集涉及阿拉伯历史、宗教等敏感主题，需确保评测内容既符合文化规范又不引入偏见。此外，模型在阿拉伯语MMLU的抽象代数（39%准确率）与高中地理（77%准确率）等科目间的显著性能差异，揭示了当前评测体系在学科难度梯度设计上的结构性挑战。
常用场景
经典使用场景
在自然语言处理领域，该数据集主要用于评估大语言模型在阿拉伯语及多元文化语境下的综合表现。其经典使用场景涵盖对模型在跨学科知识问答、情感分析、方言理解以及文化常识判断等任务上的性能度量。通过涵盖从古代文明到现代科技的136个评测配置，研究者能够系统性地洞察模型在阿拉伯世界多维度知识体系中的推理能力与鲁棒性。
解决学术问题
该数据集精准回应了当前大语言模型研究中的核心挑战——如何构建一个覆盖非英语语言且兼顾文化多样性的标准化评估框架。它解决了现有基准测试过度聚焦英语语料、忽略区域文化知识细粒度差异的学术困境。通过提供阿拉伯语多任务评测体系，促进了跨语言与跨文化模型能力的可量化比较，推动了低资源语言及地域特异性知识建模的学术进步。
衍生相关工作
该数据集催生了一系列衍生研究，包括针对阿拉伯语大模型的细粒度能力剖析工作、基于文化常识的对抗性样本生成方法，以及多语言模型在区域知识上的迁移学习策略。此外，其评测框架被部分学者借鉴以构建面向其他低资源语言（如斯瓦希里语、印地语）的文化知识基准，形成了跨语言模型评估的方法论扩展。
以上内容由遇见数据集搜集并总结生成
