文言文(古文)-现代文平行语料
收藏资源简介:
基本涵盖了大部分经典古籍著作。共计约96万句对。原始爬取的数据是篇章级对齐,经过脚本分句(按照句号分号感叹号问号划分)以及人工校对,形成共计约96万句对。 目录bitext下是文言文-现代文对齐的平行数据。此外,目录source下是文言文单语数据,target下是现代文单语数据,这两个目录下的文件内容按行对齐。
This dataset covers most classic ancient Chinese literary works, with a total of approximately 960,000 sentence pairs. The originally crawled data was aligned at the chapter level, and was then split into individual sentences via a script (splitting based on periods, semicolons, exclamation marks, and question marks) followed by manual proofreading, resulting in the finalized 960,000 sentence pairs. The `bitext` directory stores parallel aligned data between classical Chinese and modern Chinese. Additionally, the `source` directory contains monolingual classical Chinese data, and the `target` directory holds monolingual modern Chinese data; the files under these two directories are line-aligned with one another.




