Compressed fastText Embeddings

Compressed fastText embeddings. The original embeddings have been obtained from https://fasttext.cc/, compression was done using standard settings via the https://github.com/avidale/compress-fasttext library. By reducing the download and in-memory-size of these embeddings by several magnitudes, it becomes feasible to work with them in highly memory-constrained environments such as Binder. This is useful for teaching purposes and a prerequisite for upcoming interactive publications we are working on. The single files can be loaded by using `compress_fasttext.models.CompressedFastTextKeyedVectors.load`. The word vectors are distributed under the <em>Creative Commons Attribution-Share-Alike License 3.0</em>. For details and references on fastText, see https://fasttext.cc/docs/en/crawl-vectors.html

本数据集为经压缩处理的fastText词嵌入。原始词嵌入获取自https://fasttext.cc/，压缩过程通过https://github.com/avidale/compress-fasttext库的标准参数配置完成。该操作可将此类词嵌入的下载体积与内存占用压缩数个数量级，使其能够在Binder等内存资源极度受限的环境中进行使用，适用于教学场景，同时也是我们正在开发的交互式出版物的前置必要条件。单个词嵌入文件可通过`compress_fasttext.models.CompressedFastTextKeyedVectors.load`接口进行加载。本词嵌入以知识共享署名-相同方式共享3.0协议（Creative Commons Attribution-Share-Alike License 3.0）进行分发。如需了解fastText的相关细节与参考文献，请访问https://fasttext.cc/docs/en/crawl-vectors.html。