ENGLISH-AKUAPEM TWI PARALLEL CORPUS

This dataset <em><strong>(verified_data.csv)</strong></em> is bilingual machine translation training corpus for English and Akuapem Twi of 25,421 sentence pairs. <br> A transformer-based machine translator was used to generate initial translations in Akuapem Twi, which were later verified and corrected where necessary by native speakers. <br> The main idea of a typical use case for the dataset is for further training of machine translation models in Akuapem Twi.<br> The data can also be used for other downstream NLP tasks such as Named Entity Recognition and POS tagging, with appropriate additional annotations. <br> Another potential application is training unsupervised embeddings for the Akuapem Twi language.<br> In addition a higher quality 697 crowdsourced sentences <em><strong>(crowdsourced_data.csv) </strong></em>are provided for use as an evaluation set for the tasks highlighted above. It is recommended as a testing dataset for machine translation English to Twi and Twi to English models. <strong>Acknowledgement</strong>: This project was supported by the AI4D language dataset fellowship through K4all and Zindi Africa

本数据集（verified_data.csv）为英语与阿夸皮姆特维语（Akuapem Twi）的双语机器翻译训练语料库，共包含25421个句对。<br>本数据集采用基于Transformer的机器翻译模型生成阿夸皮姆特维语初始译文，后续由母语使用者根据实际需求对译文进行验证与修正。<br>该数据集的典型应用场景为针对阿夸皮姆特维语的机器翻译模型的进一步训练。<br>经适当附加标注后，该数据还可用于其他自然语言处理下游任务，例如命名实体识别（Named Entity Recognition）与词性标注（Part-of-Speech Tagging，简称POS标注）。<br>另一项潜在应用为针对阿夸皮姆特维语的无监督词嵌入训练。<br>此外，本数据集还提供了697条高质量众包句子（crowdsourced_data.csv），可作为上述任务的评估集，推荐用作英-特维语、特维语-英语机器翻译模型的测试数据集。<br>致谢：本项目由K4all与Zindi Africa通过AI4D语言数据集奖学金项目资助。