irds/lotte_science_test
收藏资源简介:
--- pretty_name: '`lotte/science/test`' viewer: false source_datasets: [] task_categories: - text-retrieval --- # Dataset Card for `lotte/science/test` The `lotte/science/test` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package. For more information about the dataset, see the [documentation](https://ir-datasets.com/lotte#lotte/science/test). # Data This dataset provides: - `docs` (documents, i.e., the corpus); count=1,694,164 This dataset is used by: [`lotte_science_test_forum`](https://huggingface.co/datasets/irds/lotte_science_test_forum), [`lotte_science_test_search`](https://huggingface.co/datasets/irds/lotte_science_test_search) ## Usage ```python from datasets import load_dataset docs = load_dataset('irds/lotte_science_test', 'docs') for record in docs: record # {'doc_id': ..., 'text': ...} ``` Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the data in 🤗 Dataset format. ## Citation Information ``` @article{Santhanam2021ColBERTv2, title = "ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction", author = "Keshav Santhanam and Omar Khattab and Jon Saad-Falcon and Christopher Potts and Matei Zaharia", journal= "arXiv preprint arXiv:2112.01488", year = "2021", url = "https://arxiv.org/abs/2112.01488" } ```
--- 数据集名称:`lotte/science/test` 查看器:禁用 源数据集:无 任务类别: - 文本检索 --- # `lotte/science/test` 数据集卡片 本`lotte/science/test`数据集由[ir-datasets](https://ir-datasets.com/)工具包提供。如需了解该数据集的更多详情,请参阅[官方文档](https://ir-datasets.com/lotte#lotte/science/test)。 # 数据概况 本数据集包含以下内容: - `docs`(文档,即语料库),共计1,694,164条。 本数据集可被以下数据集调用:[`lotte_science_test_forum`](https://huggingface.co/datasets/irds/lotte_science_test_forum)、[`lotte_science_test_search`](https://huggingface.co/datasets/irds/lotte_science_test_search)。 ## 使用方法 python from datasets import load_dataset docs = load_dataset('irds/lotte_science_test', 'docs') for record in docs: record # {'doc_id': ..., 'text': ...} 请注意,调用`load_dataset`函数将下载该数据集(若数据集未公开,则会提供访问指引),并将数据转换为🤗数据集(Hugging Face Datasets)格式进行本地存储。 ## 引用信息 @article{Santhanam2021ColBERTv2, title = "ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction", author = "Keshav Santhanam and Omar Khattab and Jon Saad-Falcon and Christopher Potts and Matei Zaharia", journal= "arXiv preprint arXiv:2112.01488", year = "2021", url = "https://arxiv.org/abs/2112.01488" }
数据集概述
数据集名称
lotte/science/test
数据来源
由 ir-datasets 包提供。
数据内容
- 数据类型:
docs(文档,即语料库) - 文档数量: 1,694,164
使用场景
该数据集被用于以下项目:
引用信息
@article{Santhanam2021ColBERTv2, title = "ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction", author = "Keshav Santhanam and Omar Khattab and Jon Saad-Falcon and Christopher Potts and Matei Zaharia", journal= "arXiv preprint arXiv:2112.01488", year = "2021", url = "https://arxiv.org/abs/2112.01488" }




