SauravP97/tiny-stories-tokenized-bpe

--- dataset_info: features: - name: text dtype: string - name: input_ids list: int32 - name: attention_mask list: int8 splits: - name: train num_bytes: 7354858875 num_examples: 2119719 - name: validation num_bytes: 75776630 num_examples: 21990 download_size: 1741360985 dataset_size: 7430635505 configs: - config_name: default data_files: - split: train path: data/train-* - split: validation path: data/validation-* license: mit task_categories: - text-generation pretty_name: Tiny Stories dataset tokenized with BPE ---