遇见数据集

milano0017/hiragana_aozora

收藏
Hugging Face2025-11-10 更新2025-11-15 收录
官方服务:

资源简介:

该数据集基于经过清洗的日本文学文库“Aozora Bunko”。使用fugashi工具和unidic-lite词典进行了词性分析,并将每个词素转换为平假名。数据集中移除了所有非平假名字符,例如标点符号和数字。

This dataset is based on the cleaned version of Aozora Bunko, a Japanese text corpus. It has been processed through morphological analysis using fugashi with the unidic-lite dictionary, converting each morpheme into hiragana. All non-hiragana symbols, such as punctuation marks and numbers, have been removed from the dataset.

提供机构:
milano0017
二维码
社区交流群
二维码
科研交流群
商业服务