eswardivi/telugu_dataset

--- dataset_info: - config_name: telugu_asr features: - name: sentence dtype: string splits: - name: train num_bytes: 47887486 num_examples: 209270 download_size: 20219871 dataset_size: 47887486 - config_name: telugu_nlp features: - name: text dtype: string splits: - name: train num_bytes: 387671180 num_examples: 47415 download_size: 150012515 dataset_size: 387671180 - config_name: wikipedia features: - name: text dtype: string splits: - name: train num_bytes: 710613522 num_examples: 87854 download_size: 209754217 dataset_size: 710613522 configs: - config_name: telugu_asr data_files: - split: train path: telugu_asr/train-* - config_name: telugu_nlp data_files: - split: train path: telugu_nlp/train-* - config_name: wikipedia data_files: - split: train path: wikipedia/train-* --- # Dataset This repository contains the final dataset created using various resources. The primary datasets used for the construction of this final dataset are: - [Telugu NLP Dataset from Kaggle](https://www.kaggle.com/datasets/sudalairajkumar/telugu-nlp) - [Telugu ASR Corpus from HuggingFace](https://huggingface.co/datasets/parambharat/telugu_asr_corpus) - [Wikipedia Telugu Dataset from Wikimedia on HuggingFace](https://huggingface.co/datasets/wikimedia/wikipedia) These datasets have been combined to form a comprehensive resource for Telugu Natural Language Processing (NLP) tasks.

原始信息汇总

数据集概述

数据集配置

1. Telugu ASR

• 特征:
  • 名称: sentence
  • 数据类型: string
• 分割:
  • 名称: train
  • 字节数: 47887486
  • 样本数: 209270
• 下载大小: 20219871
• 数据集大小: 47887486
• 数据文件:
  • 分割: train
  • 路径: telugu_asr/train-*

2. Telugu NLP

• 特征:
  • 名称: text
  • 数据类型: string
• 分割:
  • 名称: train
  • 字节数: 387671180
  • 样本数: 47415
• 下载大小: 150012515
• 数据集大小: 387671180
• 数据文件:
  • 分割: train
  • 路径: telugu_nlp/train-*

3. Wikipedia

• 特征:
  • 名称: text
  • 数据类型: string
• 分割:
  • 名称: train
  • 字节数: 710613522
  • 样本数: 87854
• 下载大小: 209754217
• 数据集大小: 710613522
• 数据文件:
  • 分割: train
  • 路径: wikipedia/train-*