yguooo/summarize_from_feedback_tldr_3_filtered_oai_preprocessing_llama3_scene4

该数据集来源于OpenAI的Summarize from Feedback任务，主要用于文本摘要任务。数据集包含Reddit帖子及其摘要，以及经过预处理的查询和参考响应。数据集的列包括帖子的唯一标识符、所属子版块、标题、正文、摘要、参考响应等。此外，还包含通过预处理脚本添加的列，如查询、查询的token化版本、参考响应的token化版本等。数据集分为训练集、验证集和测试集，分别包含116722、6447和6553个样本。

This dataset is derived from OpenAIs Summarize from Feedback task, primarily used for text summarization tasks. The dataset includes Reddit posts and their summaries, along with preprocessed queries and reference responses. The columns in the dataset include the unique identifier of the post, the subreddit it belongs to, the title, the body, the summary, the reference response, etc. Additionally, it includes columns added by the preprocessing script, such as the query, the tokenized version of the query, the tokenized version of the reference response, etc. The dataset is divided into training, validation, and test sets, containing 116722, 6447, and 6553 samples respectively.