upstage/Pretraining_Dataset

该数据集包含60000个训练样本，每个样本由文本内容（text字段）和元数据（meta字段）组成，其中元数据包括redpajama_set_name字段，可能表示数据来源的子集名称。数据集总大小约为257MB，下载大小约为150MB，适用于自然语言处理任务，如文本分析或模型训练。

This dataset contains 60,000 training examples, each consisting of text content (text field) and metadata (meta field), where the metadata includes a redpajama_set_name field, likely indicating the subset name of the data source. The total dataset size is approximately 257MB, with a download size of about 150MB, suitable for natural language processing tasks such as text analysis or model training.