bismarck91/enA-frA-tokenised-bc

这是一个包含源语言和目标语言词汇表示的数据集，具体包括global_tokens和semantic_tokens两种类型的表示，分别以int32和int64的序列形式存在。数据集分为train分割，包含10个示例，数据大小为136880字节。

This dataset contains lexical representations of source and target languages, specifically including global_tokens and semantic_tokens in the forms of int32 and int64 sequences respectively. The dataset is split into a train partition, which includes 10 examples and is 136880 bytes in size.