asdfceeegdag/civil_comments

---
language:
- en
license: cc0-1.0
paperswithcode_id: civil-comments
pretty_name: Civil Comments
tags:
- toxic-comment-classification
task_categories:
- text-classification
task_ids:
- multi-label-classification
dataset_info:
features:
- name: text
dtype: string
- name: toxicity
dtype: float32
- name: severe_toxicity
dtype: float32
- name: obscene
dtype: float32
- name: threat
dtype: float32
- name: insult
dtype: float32
- name: identity_attack
dtype: float32
- name: sexual_explicit
dtype: float32
splits:
- name: train
num_bytes: 594805164
num_examples: 1804874
- name: validation
num_bytes: 32216880
num_examples: 97320
- name: test
num_bytes: 31963524
num_examples: 97320
download_size: 422061071
dataset_size: 658985568
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
- split: validation
path: data/validation-*
- split: test
path: data/test-*
---

# Dataset Card for "civil_comments"

## Table of Contents
- [Dataset Description](#dataset-description)
- [Dataset Summary](#dataset-summary)
- [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
- [Languages](#languages)
- [Dataset Structure](#dataset-structure)
- [Data Instances](#data-instances)
- [Data Fields](#data-fields)
- [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
- [Curation Rationale](#curation-rationale)
- [Source Data](#source-data)
- [Annotations](#annotations)
- [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
- [Social Impact of Dataset](#social-impact-of-dataset)
- [Discussion of Biases](#discussion-of-biases)
- [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
- [Dataset Curators](#dataset-curators)
- [Licensing Information](#licensing-information)
- [Citation Information](#citation-information)
- [Contributions](#contributions)

## Dataset Description

- **Homepage:** [https://www.kaggle.com/c/jigsaw-unintended-bias-in-toxicity-classification/data](https://www.kaggle.com/c/jigsaw-unintended-bias-in-toxicity-classification/data)
- **Repository:** https://github.com/conversationai/unintended-ml-bias-analysis
- **Paper:** https://arxiv.org/abs/1903.04561
- **Point of Contact:** [More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
- **Size of downloaded dataset files:** 414.95 MB
- **Size of the generated dataset:** 661.23 MB
- **Total amount of disk used:** 1.08 GB

### Dataset Summary

The comments in this dataset come from an archive of the Civil Comments
platform, a commenting plugin for independent news sites. These public comments
were created from 2015 - 2017 and appeared on approximately 50 English-language
news sites across the world. When Civil Comments shut down in 2017, they chose
to make the public comments available in a lasting open archive to enable future
research. The original data, published on figshare, includes the public comment
text, some associated metadata such as article IDs, timestamps and
commenter-generated "civility" labels, but does not include user ids. Jigsaw
extended this dataset by adding additional labels for toxicity and identity
mentions. This data set is an exact replica of the data released for the
Jigsaw Unintended Bias in Toxicity Classification Kaggle challenge. This
dataset is released under CC0, as is the underlying comment text.

### Supported Tasks and Leaderboards

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Languages

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Dataset Structure

### Data Instances

#### default

- **Size of downloaded dataset files:** 414.95 MB
- **Size of the generated dataset:** 661.23 MB
- **Total amount of disk used:** 1.08 GB

An example of 'validation' looks as follows.
```
{
"identity_attack": 0.0,
"insult": 0.0,
"obscene": 0.0,
"severe_toxicity": 0.0,
"sexual_explicit": 0.0,
"text": "The public test.",
"threat": 0.0,
"toxicity": 0.0
}
```

### Data Fields

The data fields are the same among all splits.

#### default
- `text`: a `string` feature.
- `toxicity`: a `float32` feature.
- `severe_toxicity`: a `float32` feature.
- `obscene`: a `float32` feature.
- `threat`: a `float32` feature.
- `insult`: a `float32` feature.
- `identity_attack`: a `float32` feature.
- `sexual_explicit`: a `float32` feature.

### Data Splits

| name | train |validation|test |
|-------|------:|---------:|----:|
|default|1804874| 97320|97320|

## Dataset Creation

### Curation Rationale

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

#### Who are the source language producers?

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Annotations

#### Annotation process

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

#### Who are the annotators?

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Personal and Sensitive Information

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Discussion of Biases

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Other Known Limitations

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Additional Information

### Dataset Curators

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Licensing Information

This dataset is released under [CC0 1.0](https://creativecommons.org/publicdomain/zero/1.0/).

### Citation Information

```
@article{DBLP:journals/corr/abs-1903-04561,
author = {Daniel Borkan and
Lucas Dixon and
Jeffrey Sorensen and
Nithum Thain and
Lucy Vasserman},
title = {Nuanced Metrics for Measuring Unintended Bias with Real Data for Text
Classification},
journal = {CoRR},
volume = {abs/1903.04561},
year = {2019},
url = {http://arxiv.org/abs/1903.04561},
archivePrefix = {arXiv},
eprint = {1903.04561},
timestamp = {Sun, 31 Mar 2019 19:01:24 +0200},
biburl = {https://dblp.org/rec/bib/journals/corr/abs-1903-04561},
bibsource = {dblp computer science bibliography, https://dblp.org}
}

```

### Contributions

Thanks to [@lewtun](https://github.com/lewtun), [@patrickvonplaten](https://github.com/patrickvonplaten), [@thomwolf](https://github.com/thomwolf) for adding this dataset.

---
language:
- 英语
license: CC0 1.0
paperswithcode_id: civil-comments
pretty_name: 民用评论（Civil Comments）
tags:
- 有毒评论分类（toxic-comment-classification）
task_categories:
- 文本分类（text-classification）
task_ids:
- 多标签分类（multi-label-classification）
dataset_info:
features:
- name: 文本（text）
dtype: 字符串
- name: 毒性（toxicity）
dtype: float32
- name: 严重毒性（severe_toxicity）
dtype: float32
- name: 淫秽内容（obscene）
dtype: float32
- name: 威胁（threat）
dtype: float32
- name: 侮辱（insult）
dtype: float32
- name: 身份攻击（identity_attack）
dtype: float32
- name: 露骨性内容（sexual_explicit）
dtype: float32
splits:
- name: 训练集（train）
num_bytes: 594805164
num_examples: 1804874
- name: 验证集（validation）
num_bytes: 32216880
num_examples: 97320
- name: 测试集（test）
num_bytes: 31963524
num_examples: 97320
download_size: 422061071
dataset_size: 658985568
configs:
- config_name: 默认配置（default）
data_files:
- split: 训练集（train）
path: data/train-*
- split: 验证集（validation）
path: data/validation-*
- split: 测试集（test）
path: data/test-*
---

# "民用评论（Civil Comments）"数据集卡片

## 目录
- [数据集描述](#dataset-description)
- [数据集概述](#dataset-summary)
- [支持的任务与排行榜](#supported-tasks-and-leaderboards)
- [语言](#languages)
- [数据集结构](#dataset-structure)
- [数据样例](#data-instances)
- [数据字段](#data-fields)
- [数据划分](#data-splits)
- [数据集构建](#dataset-creation)
- [遴选依据](#curation-rationale)
- [源数据](#source-data)
- [标注信息](#annotations)
- [个人与敏感信息](#personal-and-sensitive-information)
- [数据集使用注意事项](#considerations-for-using-the-data)
- [数据集的社会影响](#social-impact-of-dataset)
- [偏差讨论](#discussion-of-biases)
- [其他已知局限性](#other-known-limitations)
- [附加信息](#additional-information)
- [数据集策展人](#dataset-curators)
- [许可信息](#licensing-information)
- [引用信息](#citation-information)
- [贡献致谢](#contributions)

## 数据集描述
- **主页**：[https://www.kaggle.com/c/jigsaw-unintended-bias-in-toxicity-classification/data](https://www.kaggle.com/c/jigsaw-unintended-bias-in-toxicity-classification/data)
- **代码仓库**：https://github.com/conversationai/unintended-ml-bias-analysis
- **相关论文**：https://arxiv.org/abs/1903.04561
- **联系方式**：[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
- **下载数据集大小**：414.95 MB
- **生成后数据集大小**：661.23 MB
- **总磁盘占用**：1.08 GB

### 数据集概述
本数据集的评论源自**民用评论（Civil Comments）**平台的存档，该平台是面向独立新闻站点的评论插件。这些公开评论发布于2015年至2017年间，来自全球约50个英语新闻站点。2017年民用评论平台关停后，其将公开评论以永久开放存档的形式发布，以支持后续研究。原始数据发布于figshare平台，包含公开评论文本、部分关联元数据（如文章ID、时间戳）以及评论者生成的"文明度"标签，但未包含用户ID。Jigsaw平台对该数据集进行了扩展，新增了毒性与身份提及相关的标注标签。本数据集与Jigsaw举办的"Jigsaw Unintended Bias in Toxicity Classification"Kaggle竞赛所发布的数据完全一致。本数据集及其中的评论文本均采用CC0协议发布。

### 支持的任务与排行榜
[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### 语言
[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## 数据集结构
### 数据样例
#### 默认配置
- **下载数据集大小**：414.95 MB
- **生成后数据集大小**：661.23 MB
- **总磁盘占用**：1.08 GB

验证集的一条样例如下：
json
{
"identity_attack": 0.0,
"insult": 0.0,
"obscene": 0.0,
"severe_toxicity": 0.0,
"sexual_explicit": 0.0,
"text": "The public test.",
"threat": 0.0,
"toxicity": 0.0
}

### 数据字段
所有数据集划分的字段均保持一致：
#### 默认配置
- `text`：字符串类型特征，代表评论文本
- `toxicity`：float32类型特征，代表文本的毒性评分
- `severe_toxicity`：float32类型特征，代表文本的严重毒性评分
- `obscene`：float32类型特征，代表文本的淫秽内容评分
- `threat`：float32类型特征，代表文本的威胁性评分
- `insult`：float32类型特征，代表文本的侮辱性评分
- `identity_attack`：float32类型特征，代表文本的身份攻击评分
- `sexual_explicit`：float32类型特征，代表文本的露骨性内容评分

### 数据划分
| 数据集划分 | 训练集样本量 | 验证集样本量 | 测试集样本量 |
| :------- | -----------: | -----------: | -----------: |
| 默认配置 | 1804874 | 97320 | 97320 |

## 数据集构建
### 遴选依据
[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### 源数据
#### 初始数据收集与标准化
[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

#### 源语言生产者是谁？
[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### 标注信息
#### 标注流程
[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

#### 标注人员是谁？
[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### 个人与敏感信息
[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## 数据集使用注意事项
### 数据集的社会影响
[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### 偏差讨论
[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### 其他已知局限性
[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## 附加信息
### 数据集策展人
[更多信息待补充](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### 许可信息
本数据集采用[CC0 1.0协议](https://creativecommons.org/publicdomain/zero/1.0/)发布。

### 引用信息
bibtex
@article{DBLP:journals/corr/abs-1903-04561,
author = {Daniel Borkan and
Lucas Dixon and
Jeffrey Sorensen and
Nithum Thain and
Lucy Vasserman},
title = {Nuanced Metrics for Measuring Unintended Bias with Real Data for Text
Classification},
journal = {CoRR},
volume = {abs/1903.04561},
year = {2019},
url = {http://arxiv.org/abs/1903.04561},
archivePrefix = {arXiv},
eprint = {1903.04561},
timestamp = {Sun, 31 Mar 2019 19:01:24 +0200},
biburl = {https://dblp.org/rec/bib/journals/corr/abs-1903-04561},
bibsource = {dblp computer science bibliography, https://dblp.org}
}

### 贡献致谢
感谢[@lewtun](https://github.com/lewtun)、[@patrickvonplaten](https://github.com/patrickvonplaten)、[@thomwolf](https://github.com/thomwolf)为本数据集的收录提供支持。