irds/mr-tydi_id_train

mr-tydi/id/train数据集是一个用于文本检索任务的数据集，包含4,902个查询和相关性评估。文档数据来源于`irds/mr-tydi_id`数据集。--- 数据集展示名称: '`mr-tydi/id/train`' 数据集查看器: 不可用 源数据集: ['irds/mr-tydi_id'] 任务类别: - 文本检索 (text-retrieval) --- # `mr-tydi/id/train` 数据集卡片 本`mr-tydi/id/train`数据集由[ir-datasets](https://ir-datasets.com/)工具包提供。如需了解该数据集的更多详情，请参阅[官方文档](https://ir-datasets.com/mr-tydi#mr-tydi/id/train)。 # 数据集内容 本数据集包含以下内容： - `queries`（即查询主题，queries）：共计4902条 - `qrels`（即相关性标注，qrels）：共计4902条 - 如需获取`docs`（文档集），请使用 [`irds/mr-tydi_id`](https://huggingface.co/datasets/irds/mr-tydi_id) 数据集 ## 使用方法 python from datasets import load_dataset queries = load_dataset('irds/mr-tydi_id_train', 'queries') for record in queries: record # {'query_id': ..., 'text': ...} qrels = load_dataset('irds/mr-tydi_id_train', 'qrels') for record in qrels: record # {'query_id': ..., 'doc_id': ..., 'relevance': ..., 'iteration': ...} 请注意，调用`load_dataset`函数将自动下载该数据集（若数据集未公开，则会提供访问指引），并将数据集转换为🤗 数据集格式进行存储。 ## 引用信息 @article{Zhang2021MrTyDi, title={{Mr. TyDi}: A Multi-lingual Benchmark for Dense Retrieval}, author={Xinyu Zhang and Xueguang Ma and Peng Shi and Jimmy Lin}, year={2021}, journal={arXiv:2108.08787}, } @article{Clark2020TyDiQa, title={{TyDi QA}: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages}, author={Jonathan H. Clark and Eunsol Choi and Michael Collins and Dan Garrette and Tom Kwiatkowski and Vitaly Nikolaev and Jennimaria Palomaki}, year={2020}, journal={Transactions of the Association for Computational Linguistics} }

原始信息汇总

Dataset Card for mr-tydi/id/train

Overview

• Dataset Name: mr-tydi/id/train
• Provider: ir-datasets
• Documentation: Link

Data Details

Provided Data

• Queries: 4,902 topics
• Qrels: 4,902 relevance assessments

Additional Data Source

• Docs: irds/mr-tydi_id

Usage Example

python from datasets import load_dataset

queries = load_dataset(irds/mr-tydi_id_train, queries) for record in queries: record # {query_id: ..., text: ...}

qrels = load_dataset(irds/mr-tydi_id_train, qrels) for record in qrels: record # {query_id: ..., doc_id: ..., relevance: ..., iteration: ...}

Citation

@article{Zhang2021MrTyDi, title={{Mr. TyDi}: A Multi-lingual Benchmark for Dense Retrieval}, author={Xinyu Zhang and Xueguang Ma and Peng Shi and Jimmy Lin}, year={2021}, journal={arXiv:2108.08787}, } @article{Clark2020TyDiQa, title={{TyDi QA}: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages}, author={Jonathan H. Clark and Eunsol Choi and Michael Collins and Dan Garrette and Tom Kwiatkowski and Vitaly Nikolaev and Jennimaria Palomaki}, year={2020}, journal={Transactions of the Association for Computational Linguistics} }