AlgorithmicResearchGroup/arxiv-beir-500k-generated-queries

---
dataset_info:
features:
- name: query-id
dtype: string
- name: corpus-id
dtype: int64
- name: score
dtype: int64
splits:
- name: train
num_bytes: 44772988
num_examples: 1480132
download_size: 14299004
dataset_size: 44772988
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---
### Dataset Summary

A BEIR style dataset derived from [ArXiv](https://arxiv.org/)

### Languages

All tasks are in English (`en`).

## Dataset Structure

The dataset contains a corpus, queries and qrels (relevance judgments file). They must be in the following format:
- `corpus` file: a `.jsonl` file (jsonlines) that contains a list of dictionaries, each with three fields `_id` with unique document identifier, `title` with document title (optional) and `text` with document paragraph or passage. For example: `{"_id": "doc1", "title": "Albert Einstein", "text": "Albert Einstein was a German-born...."}`
- `queries` file: a `.jsonl` file (jsonlines) that contains a list of dictionaries, each with two fields `_id` with unique query identifier and `text` with query text. For example: `{"_id": "q1", "text": "Who developed the mass-energy equivalence formula?"}`
- `qrels` file: a `.tsv` file (tab-seperated) that contains three columns, i.e. the `query-id`, `corpus-id` and `score` in this order. Keep 1st row as header. For example: `q1 doc1 1`

### Data Instances

A high level example of any beir dataset:

```python
corpus = {
"doc1" : {
"title": "Albert Einstein",
"text": "Albert Einstein was a German-born theoretical physicist. who developed the theory of relativity, \
one of the two pillars of modern physics (alongside quantum mechanics). His work is also known for \
its influence on the philosophy of science. He is best known to the general public for his mass–energy \
equivalence formula E = mc2, which has been dubbed 'the world's most famous equation'. He received the 1921 \
Nobel Prize in Physics 'for his services to theoretical physics, and especially for his discovery of the law \
of the photoelectric effect', a pivotal step in the development of quantum theory."
},
"doc2" : {
"title": "", # Keep title an empty string if not present
"text": "Wheat beer is a top-fermented beer which is brewed with a large proportion of wheat relative to the amount of \
malted barley. The two main varieties are German Weißbier and Belgian witbier; other types include Lambic (made\
with wild yeast), Berliner Weisse (a cloudy, sour beer), and Gose (a sour, salty beer)."
},
}

queries = {
"q1" : "Who developed the mass-energy equivalence formula?",
"q2" : "Which beer is brewed with a large proportion of wheat?"
}

qrels = {
"q1" : {"doc1": 1},
"q2" : {"doc2": 1},
}
```

### Data Fields

Examples from all configurations have the following features:

### Corpus
- `corpus`: a `dict` feature representing the document title and passage text, made up of:
- `_id`: a `string` feature representing the unique document id
- `title`: a `string` feature, denoting the title of the document.
- `text`: a `string` feature, denoting the text of the document.

### Queries
- `queries`: a `dict` feature representing the query, made up of:
- `_id`: a `string` feature representing the unique query id
- `text`: a `string` feature, denoting the text of the query.

### Qrels
- `qrels`: a `dict` feature representing the query document relevance judgements, made up of:
- `_id`: a `string` feature representing the query id
- `_id`: a `string` feature, denoting the document id.
- `score`: a `int32` feature, denoting the relevance judgement between query and document.

## Dataset Creation

### Curation Rationale

[Needs More Information]

### Source Data

#### Initial Data Collection and Normalization

[Needs More Information]

#### Who are the source language producers?

[Needs More Information]

## Considerations for Using the Data

### Social Impact of Dataset

[Needs More Information]

### Discussion of Biases

[Needs More Information]

### Other Known Limitations

[Needs More Information]

## Additional Information

### Dataset Curators

[Needs More Information]

### Licensing Information

[Needs More Information]

### Citation Information

Cite as:
```
@misc{arxiv-beir-500k-generated-queries,
title={arxiv-beir-500k-generated-queries},
author={Matthew Kenney},
year={2023}
}
```

---
dataset_info:
features:
- name: query-id
dtype: string
- name: corpus-id
dtype: int64
- name: score
dtype: int64
splits:
- name: train
num_bytes: 44772988
num_examples: 1480132
download_size: 14299004
dataset_size: 44772988
configs:
- config_name: default
data_files:
- split: train
path: data/train-*
---
### 数据集概览
本数据集为源自[ArXiv](https://arxiv.org/)的BEIR风格数据集。

### 语言说明
所有任务均使用英文（`en`）。

## 数据集结构
本数据集包含语料库（corpus）、查询（queries）与相关性判断文件（qrels），需遵循以下格式规范：
- **语料库文件**：采用`.jsonl`（JSON行格式）存储，内含一系列字典对象，每个字典包含三个字段：`_id`为唯一文档标识符，`title`为文档标题（可选字段），`text`为文档段落或正文内容。示例如下：`{"_id": "doc1", "title": "Albert Einstein", "text": "Albert Einstein was a German-born...."}`
- **查询文件**：采用`.jsonl`（JSON行格式）存储，内含一系列字典对象，每个字典包含两个字段：`_id`为唯一查询标识符，`text`为查询文本内容。示例如下：`{"_id": "q1", "text": "Who developed the mass-energy equivalence formula?"}`
- **相关性判断文件**：采用`.tsv`（制表符分隔值格式）存储，包含三列，依次为`query-id`、`corpus-id`与`score`，首行需保留为表头。示例如下：`q1 doc1 1`

### 数据示例
以下为任意BEIR数据集的高阶示例：
python
corpus = {
"doc1" : {
"title": "Albert Einstein",
"text": "Albert Einstein was a German-born theoretical physicist. who developed the theory of relativity, one of the two pillars of modern physics (alongside quantum mechanics). His work is also known for its influence on the philosophy of science. He is best known to the general public for his mass–energy equivalence formula E = mc2, which has been dubbed 'the world's most famous equation'. He received the 1921 Nobel Prize in Physics 'for his services to theoretical physics, and especially for his discovery of the law of the photoelectric effect', a pivotal step in the development of quantum theory."
},
"doc2" : {
"title": "", # 若无对应标题则将此字段设为空字符串
"text": "Wheat beer is a top-fermented beer which is brewed with a large proportion of wheat relative to the amount of malted barley. The two main varieties are German Weißbier and Belgian witbier; other types include Lambic (made with wild yeast), Berliner Weisse (a cloudy, sour beer), and Gose (a sour, salty beer)."
},
}

queries = {
"q1" : "Who developed the mass-energy equivalence formula?",
"q2" : "Which beer is brewed with a large proportion of wheat?"
}

qrels = {
"q1" : {"doc1": 1},
"q2" : {"doc2": 1},
}

### 数据字段
所有配置下的示例均包含以下特征：

### 语料库字段
- `corpus`：字典类型特征，用于存储文档标题与正文段落，包含以下子字段：
- `_id`：字符串类型特征，代表唯一文档标识符
- `title`：字符串类型特征，用于标识文档标题
- `text`：字符串类型特征，用于标识文档正文内容

### 查询字段
- `queries`：字典类型特征，用于存储查询内容，包含以下子字段：
- `_id`：字符串类型特征，代表唯一查询标识符
- `text`：字符串类型特征，用于标识查询文本内容

### 相关性判断字段
- `qrels`：字典类型特征，用于存储查询-文档相关性判断结果，包含以下子字段：
- `_id`：字符串类型特征，代表查询标识符
- `_id`：字符串类型特征，用于标识文档标识符
- `score`：int32类型特征，用于标识查询与文档间的相关性评分

## 数据集构建
### 筛选依据
[待补充详细信息]

### 源数据
#### 初始数据收集与标准化
[待补充详细信息]
#### 源语言内容创作者是谁？
[待补充详细信息]

## 数据使用注意事项
### 数据集社会影响
[待补充详细信息]
### 偏差分析
[待补充详细信息]
### 其他已知局限性
[待补充详细信息]

## 附加信息
### 数据集维护者
[待补充详细信息]
### 授权信息
[待补充详细信息]
### 引用信息
引用格式如下：

@misc{arxiv-beir-500k-generated-queries,
title={arxiv-beir-500k-generated-queries},
author={Matthew Kenney},
year={2023}
}