KETI-AIR/kor_squad_v2

--- language: - ko task_categories: - question-answering task_ids: - open-domain-qa - extractive-qa license: cc-by-sa-4.0 dataset_info: features: - name: data_index_by_user dtype: int32 - name: title dtype: string - name: context dtype: string - name: question dtype: string - name: answers struct: - name: text sequence: string - name: answer_start sequence: int32 splits: - name: train num_bytes: 127009200 num_examples: 130319 - name: validation num_bytes: 12410838 num_examples: 11873 download_size: 19086608 dataset_size: 139420038 --- # Dataset Card for squad_v2 ## Licensing Information The data is distributed under the [CC BY SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/deed.en) license. ## Source Data Citation Information ``` @article{2016arXiv160605250R, author = {{Rajpurkar}, Pranav and {Zhang}, Jian and {Lopyrev}, Konstantin and {Liang}, Percy}, title = "{SQuAD: 100,000+ Questions for Machine Comprehension of Text}", journal = {arXiv e-prints}, year = 2016, eid = {arXiv:1606.05250}, pages = {arXiv:1606.05250}, archivePrefix = {arXiv}, eprint = {1606.05250}, }

原始信息汇总

数据集概述

基本信息

• 语言: 韩语 (ko)
• 任务类别: 问答 (question-answering)
• 任务ID:
  • 开放领域问答 (open-domain-qa)
  • 抽取式问答 (extractive-qa)
• 许可证: CC BY SA 4.0

数据集结构

特征

• data_index_by_user: 数据类型为 int32
• title: 数据类型为 string
• context: 数据类型为 string
• question: 数据类型为 string
• answers: 结构类型，包含以下字段:
  • text: 序列类型，数据类型为 string
  • answer_start: 序列类型，数据类型为 int32

数据分割

• 训练集 (train):
  • 字节数: 127009200
  • 样本数: 130319
• 验证集 (validation):
  • 字节数: 12410838
  • 样本数: 11873

数据集大小

• 下载大小: 19086608 字节
• 数据集大小: 139420038 字节