noanabeshima/tiny_tokenizer_tokens

Name: noanabeshima/tiny_tokenizer_tokens
Creator: noanabeshima
Published: 2024-08-04 04:01:10
License: 暂无描述

Hugging Face2024-08-04 更新2024-12-14 收录

下载链接：

https://hf-mirror.com/datasets/noanabeshima/tiny_tokenizer_tokens

下载链接

链接失效反馈

官方服务：

资源简介：

--- license: mit ---

提供机构：

noanabeshima

zjguoHF/tokenized_tiny_shakespeare_dataset

--- dataset_info: features: - name: input_ids sequence: int32 - name: token_type_ids sequence: int8 - name: attention_mask sequence: int8 - name: special_tokens_mask sequence

Hugging Face2023-12-18 更新80

pasindubg/singlish_tokenized_tiny_test

--- configs: - config_name: default data_files: - split: train path: data/train-* - split: validation path: data/validation-* dataset_info: features: - name: input_ids sequence:

Hugging Face2026-01-20 更新30

SauravP97/tiny-stories-tokenized-bpe

--- dataset_info: features: - name: text dtype: string - name: input_ids list: int32 - name: attention_mask list: int8 splits: - name: train num_bytes: 7354858875 num_e

Hugging Face2026-03-04 更新20

whisper-tiny-bn-tokenizer-processor

kaggle2023-08-04 更新00

Kush26/Tiny-Stories-tokenized

这是一个训练数据集，包含input_ids、attention_mask和labels三个字段，适用于机器学习模型的训练。数据集分为训练集，共有897,753个示例，总大小为5,986,217,004字节。

Hugging Face2025-10-25 更新10