five

Columbia-NLP/DPO-HelpSteer

收藏
Hugging Face2024-07-10 更新2024-07-06 收录
下载链接:
https://hf-mirror.com/datasets/Columbia-NLP/DPO-HelpSteer
下载链接
链接失效反馈
官方服务:
资源简介:
我们将nvidia/HelpSteer数据集重新格式化为DPO数据集的通用格式。具体来说,我们将所有分数转换为[1, 10]的尺度,并通过取最佳评分响应作为chosen,随机抽取评分低于最佳响应的响应作为rejected来构建偏好对。我们跳过了所有响应分数相同的提示/数据行。

This dataset is reformatted from nvidia/HelpSteer and is used for training the LION series models. It includes multiple features such as prompt, prompt_id, chosen, rejected, messages, score_chosen, score_rejected, and other_info. The chosen and rejected features contain content and role, while other_info includes multiple scoring dimensions such as coherence, complexity, correctness, helpfulness, and verbosity. The dataset is split into train and validation parts, containing 8722 and 443 samples respectively.
提供机构:
Columbia-NLP
二维码
社区交流群
二维码
科研交流群
商业服务