autoevaluate/autoeval-eval-mathemakitten__winobias_antistereotype_test_v5-mathemak-2bec9f-2053467113

--- type: predictions tags: - autotrain - evaluation datasets: - mathemakitten/winobias_antistereotype_test_v5 eval_info: task: text_zero_shot_classification model: inverse-scaling/opt-2.7b_eval metrics: [] dataset_name: mathemakitten/winobias_antistereotype_test_v5 dataset_config: mathemakitten--winobias_antistereotype_test_v5 dataset_split: test col_mapping: text: text classes: classes target: target --- # Dataset Card for AutoTrain Evaluator This repository contains model predictions generated by [AutoTrain](https://huggingface.co/autotrain) for the following task and dataset: * Task: Zero-Shot Text Classification * Model: inverse-scaling/opt-2.7b_eval * Dataset: mathemakitten/winobias_antistereotype_test_v5 * Config: mathemakitten--winobias_antistereotype_test_v5 * Split: test To run new evaluation jobs, visit Hugging Face's [automatic model evaluator](https://huggingface.co/spaces/autoevaluate/model-evaluator). ## Contributions Thanks to [@mathemakitten](https://huggingface.co/mathemakitten) for evaluating this model.

原始信息汇总

数据集卡片

数据集概述

• 任务类型: 零样本文本分类
• 模型: inverse-scaling/opt-2.7b_eval
• 数据集: mathemakitten/winobias_antistereotype_test_v5
• 配置: mathemakitten--winobias_antistereotype_test_v5
• 数据集分割: 测试集

数据集详细信息

• 评估信息:
  • 任务: 文本零样本分类
  • 模型: inverse-scaling/opt-2.7b_eval
  • 指标: 无
  • 数据集名称: mathemakitten/winobias_antistereotype_test_v5
  • 数据集配置: mathemakitten--winobias_antistereotype_test_v5
  • 数据集分割: 测试集
  • 列映射:
    • 文本: text
    • 类别: classes
    • 目标: target

搜集汇总

背景与挑战

背景概述

该数据集是AutoTrain评估器生成的零样本文本分类结果，基于mathemakitten/winobias_antistereotype_test_v5反刻板印象测试集，使用inverse-scaling/opt-2.7b_eval模型进行预测。数据包含412行，提供文本、候选类别、真实标签和模型预测分数，用于评估模型在消除性别刻板印象方面的表现。