irds/lotte_technology_dev

--- pretty_name: '`lotte/technology/dev`' viewer: false source_datasets: [] task_categories: - text-retrieval --- # Dataset Card for `lotte/technology/dev` The `lotte/technology/dev` dataset, provided by the [ir-datasets](https://ir-datasets.com/) package. For more information about the dataset, see the [documentation](https://ir-datasets.com/lotte#lotte/technology/dev). # Data This dataset provides: - `docs` (documents, i.e., the corpus); count=1,276,222 This dataset is used by: [`lotte_technology_dev_forum`](https://huggingface.co/datasets/irds/lotte_technology_dev_forum), [`lotte_technology_dev_search`](https://huggingface.co/datasets/irds/lotte_technology_dev_search) ## Usage ```python from datasets import load_dataset docs = load_dataset('irds/lotte_technology_dev', 'docs') for record in docs: record # {'doc_id': ..., 'text': ...} ``` Note that calling `load_dataset` will download the dataset (or provide access instructions when it's not public) and make a copy of the data in 🤗 Dataset format. ## Citation Information ``` @article{Santhanam2021ColBERTv2, title = "ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction", author = "Keshav Santhanam and Omar Khattab and Jon Saad-Falcon and Christopher Potts and Matei Zaharia", journal= "arXiv preprint arXiv:2112.01488", year = "2021", url = "https://arxiv.org/abs/2112.01488" } ```

原始信息汇总

数据集概述

数据集名称

lotte/technology/dev

数据集来源

由 ir-datasets 提供。

数据集内容

• 文档数量: 1,276,222
• 文档类型: 包含 doc_id 和 text 字段。

数据集用途

被用于以下两个数据集：

• lotte_technology_dev_forum
• lotte_technology_dev_search

数据集加载示例

python from datasets import load_dataset

docs = load_dataset(irds/lotte_technology_dev, docs) for record in docs: record # {doc_id: ..., text: ...}

引用信息

@article{Santhanam2021ColBERTv2, title = "ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction", author = "Keshav Santhanam and Omar Khattab and Jon Saad-Falcon and Christopher Potts and Matei Zaharia", journal= "arXiv preprint arXiv:2112.01488", year = "2021", url = "https://arxiv.org/abs/2112.01488" }