遇见数据集

A n-grams collection extracted from the Portuguese Web

收藏
DataONE2022-12-02 更新2024-06-08 收录
官方服务:

资源简介:

The n-grams collection was extracted from the collected documents whose identified language was Portuguese. We extracted word n-grams up to the fifht order (5-grams). A set of regular expressions to tokenize the text were applied. After the extraction, all n-grams with tokens having more than 32 characters were discarded. N-grams with frequencies below 5 were discarded as well. The n-grams collection is available as a set of UTF-8 encoded files, containing the n-grams and their frequencies

创建时间:
2023-11-08
二维码
社区交流群
二维码
科研交流群
商业服务