irds/beir_fever
收藏资源简介：
--- pretty_name: '`beir/fever`' viewer: false source_datasets: [] task_categories: - text-retrieval --- # Dataset Card for `beir/fever` The `beir/fever` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package. For more information about the dataset, see the [documentation](https://ir-datasets.com/beir#beir/fever). # Data This dataset provides: - `docs` (documents, i.e., the corpus); count=5,416,568 - `queries` (i.e., topics); count=123,142 This dataset is used by: [`beir_fever_dev`](https://huggingface.co/datasets/irds/beir_fever_dev), [`beir_fever_test`](https://huggingface.co/datasets/irds/beir_fever_test), [`beir_fever_train`](https://huggingface.co/datasets/irds/beir_fever_train) ## Usage ```python from datasets import load_dataset docs = load_dataset('irds/beir_fever', 'docs') for record in docs: record # {'doc_id': ..., 'text': ..., 'title': ...} queries = load_dataset('irds/beir_fever', 'queries') for record in queries: record # {'query_id': ..., 'text': ...} ``` Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the data in 🤗 Dataset format. ## Citation Information ``` @inproceedings{Thorne2018Fever, title = "{FEVER}: a Large-scale Dataset for Fact Extraction and {VER}ification", author = "Thorne, James and Vlachos, Andreas and Christodoulopoulos, Christos and Mittal, Arpit", booktitle = "Proceedings of the 2018 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)", month = jun, year = "2018", address = "New Orleans, Louisiana", publisher = "Association for Computational Linguistics", url = "https://www.aclweb.org/anthology/N18-1074", doi = "10.18653/v1/N18-1074", pages = "809--819" } @article{Thakur2021Beir, title = "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models", author = "Thakur, Nandan and Reimers, Nils and Rücklé, Andreas and Srivastava, Abhishek and Gurevych, Iryna", journal= "arXiv preprint arXiv:2104.08663", month = "4", year = "2021", url = "https://arxiv.org/abs/2104.08663", } ```
--- pretty_name: '`beir/fever`' viewer: 否 source_datasets: [] task_categories: - 文本检索（text-retrieval） --- # `beir/fever` 数据集卡片 本`beir/fever`数据集由[ir-datasets](https://ir-datasets.com/)工具包提供。如需了解该数据集的详细信息，请参阅[官方文档](https://ir-datasets.com/beir#beir/fever)。 # 数据 本数据集包含以下两类数据： - `docs`（文档，即语料库）：总计5,416,568条 - `queries`（查询，即主题）：总计123,142条 以下数据集均使用本数据集：[`beir_fever_dev`](https://huggingface.co/datasets/irds/beir_fever_dev)、[`beir_fever_test`](https://huggingface.co/datasets/irds/beir_fever_test)、[`beir_fever_train`](https://huggingface.co/datasets/irds/beir_fever_train) ## 使用方法 python from datasets import load_dataset docs = load_dataset('irds/beir_fever', 'docs') for record in docs: record # {'doc_id': ..., 'text': ..., 'title': ...} queries = load_dataset('irds/beir_fever', 'queries') for record in queries: record # {'query_id': ..., 'text': ...} 请注意，调用`load_dataset`将下载该数据集（若数据集未公开则会提供访问指引），并将数据转换为Hugging Face数据集（🤗 Dataset）格式。 ## 引用信息 @inproceedings{Thorne2018Fever, title = "{FEVER}：面向事实抽取与验证的大规模数据集", author = "Thorne, James and Vlachos, Andreas and Christodoulopoulos, Christos and Mittal, Arpit", booktitle = "2018年计算语言学协会北美分会会议论文集：人类语言技术，第1卷（长文）", month = "jun", year = "2018", address = "美国路易斯安那州新奥尔良市", publisher = "计算语言学协会", url = "https://www.aclweb.org/anthology/N18-1074", doi = "10.18653/v1/N18-1074", pages = "809--819" } @article{Thakur2021Beir, title = "BEIR：面向信息检索模型零样本（Zero-shot）评估的异构基准测试集", author = "Thakur, Nandan and Reimers, Nils and Rücklé, Andreas and Srivastava, Abhishek and Gurevych, Iryna", journal = "arXiv预印本 arXiv:2104.08663", month = "4", year = "2021", url = "https://arxiv.org/abs/2104.08663", }
数据集概述：beir/fever
数据集信息
- 名称：
beir/fever - 提供者：ir-datasets
- 任务类别：text-retrieval
数据内容
- 文档 (
docs)：5,416,568个 - 查询 (
queries)：123,142个
使用方式
python from datasets import load_dataset
docs = load_dataset(irds/beir_fever, docs) for record in docs: record # {doc_id: ..., text: ..., title: ...}
queries = load_dataset(irds/beir_fever, queries) for record in queries: record # {query_id: ..., text: ...}
引用信息
@inproceedings{Thorne2018Fever, title = "{FEVER}: a Large-scale Dataset for Fact Extraction and {VER}ification", author = "Thorne, James and Vlachos, Andreas and Christodoulopoulos, Christos and Mittal, Arpit", booktitle = "Proceedings of the 2018 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)", month = jun, year = "2018", address = "New Orleans, Louisiana", publisher = "Association for Computational Linguistics", url = "https://www.aclweb.org/anthology/N18-1074", doi = "10.18653/v1/N18-1074", pages = "809--819" } @article{Thakur2021Beir, title = "BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models", author = "Thakur, Nandan and Reimers, Nils and Rücklé, Andreas and Srivastava, Abhishek and Gurevych, Iryna", journal= "arXiv preprint arXiv:2104.08663", month = "4", year = "2021", url = "https://arxiv.org/abs/2104.08663", }
