Adeptschneider/CiviVox-Swahili-text-corpus

该数据集包含从AfriBERTa Corpus中提取的斯瓦希里语文本数据，适用于多种自然语言处理任务。数据集包含两个主要列：`id`（每个文本条目的唯一标识符）和`text`（斯瓦希里语文本内容）。数据集通过加载AfriBERTa Corpus的斯瓦希里语子集，合并训练和测试分割，并进行随机打乱后创建。适用于语言建模、文本分类、命名实体识别、机器翻译、情感分析等任务。

This dataset is a comprehensive collection of Swahili text data derived from the Swahili subset of the AfriBERTa Corpus. It contains two main fields: `id` and `text`, representing the unique identifier and Swahili text content of each entry, respectively. The dataset combines the training and test splits from the original AfriBERTa Corpus and has been shuffled with a fixed seed for reproducibility. It is suitable for various natural language processing tasks such as language modeling, text classification, named entity recognition, machine translation, sentiment analysis, and more. However, the dataset is limited to the content of the original AfriBERTa Corpus, may not include all dialects or variations of Swahili, and the quality and accuracy of the text content depend on the original data source.