japanese-asr/ja2en.s2t_translation
收藏Hugging Face2024-09-24 更新2025-04-12 收录
下载链接:
https://hf-mirror.com/datasets/japanese-asr/ja2en.s2t_translation
下载链接
链接失效反馈官方服务:
资源简介:
---
dataset_info:
- config_name: covost2
features:
- name: client_id
dtype: string
- name: audio
dtype:
audio:
sampling_rate: 16000
- name: transcription
dtype: string
- name: translation
dtype: string
- name: id
dtype: string
splits:
- name: test
num_bytes: 25511505.0
num_examples: 684
- name: validation
num_bytes: 24579157.0
num_examples: 635
download_size: 49765393
dataset_size: 50090662.0
- config_name: fleurs
features:
- name: sentence_id
dtype: int32
- name: num_samples
dtype: int32
- name: audio
dtype:
audio:
sampling_rate: 16000
- name: transcription
dtype: string
- name: raw_transcription
dtype: string
- name: gender
dtype:
class_label:
names:
'0': male
'1': female
'2': other
- name: lang_id
dtype:
class_label:
names:
'0': af_za
'1': am_et
'2': ar_eg
'3': as_in
'4': ast_es
'5': az_az
'6': be_by
'7': bg_bg
'8': bn_in
'9': bs_ba
'10': ca_es
'11': ceb_ph
'12': ckb_iq
'13': cmn_hans_cn
'14': cs_cz
'15': cy_gb
'16': da_dk
'17': de_de
'18': el_gr
'19': en_us
'20': es_419
'21': et_ee
'22': fa_ir
'23': ff_sn
'24': fi_fi
'25': fil_ph
'26': fr_fr
'27': ga_ie
'28': gl_es
'29': gu_in
'30': ha_ng
'31': he_il
'32': hi_in
'33': hr_hr
'34': hu_hu
'35': hy_am
'36': id_id
'37': ig_ng
'38': is_is
'39': it_it
'40': ja_jp
'41': jv_id
'42': ka_ge
'43': kam_ke
'44': kea_cv
'45': kk_kz
'46': km_kh
'47': kn_in
'48': ko_kr
'49': ky_kg
'50': lb_lu
'51': lg_ug
'52': ln_cd
'53': lo_la
'54': lt_lt
'55': luo_ke
'56': lv_lv
'57': mi_nz
'58': mk_mk
'59': ml_in
'60': mn_mn
'61': mr_in
'62': ms_my
'63': mt_mt
'64': my_mm
'65': nb_no
'66': ne_np
'67': nl_nl
'68': nso_za
'69': ny_mw
'70': oc_fr
'71': om_et
'72': or_in
'73': pa_in
'74': pl_pl
'75': ps_af
'76': pt_br
'77': ro_ro
'78': ru_ru
'79': sd_in
'80': sk_sk
'81': sl_si
'82': sn_zw
'83': so_so
'84': sr_rs
'85': sv_se
'86': sw_ke
'87': ta_in
'88': te_in
'89': tg_tj
'90': th_th
'91': tr_tr
'92': uk_ua
'93': umb_ao
'94': ur_pk
'95': uz_uz
'96': vi_vn
'97': wo_sn
'98': xh_za
'99': yo_ng
'100': yue_hant_hk
'101': zu_za
'102': all
- name: language
dtype: string
- name: lang_group_id
dtype:
class_label:
names:
'0': western_european_we
'1': eastern_european_ee
'2': central_asia_middle_north_african_cmn
'3': sub_saharan_african_ssa
'4': south_asian_sa
'5': south_east_asian_sea
'6': chinese_japanase_korean_cjk
- name: translation
dtype: string
- name: raw_translation
dtype: string
splits:
- name: test
num_bytes: 545153848.0
num_examples: 650
- name: validation
num_bytes: 217102833.0
num_examples: 266
download_size: 758218618
dataset_size: 762256681.0
configs:
- config_name: covost2
data_files:
- split: test
path: covost2/test-*
- split: validation
path: covost2/validation-*
- config_name: fleurs
data_files:
- split: test
path: fleurs/test-*
- split: validation
path: fleurs/validation-*
---
数据集信息:
- 配置名称:covost2
特征字段:
- 字段名:client_id(客户端ID),数据类型:字符串
- 字段名:audio(音频),数据类型:
音频:采样率为16000Hz
- 字段名:transcription(转录文本),数据类型:字符串
- 字段名:translation(翻译文本),数据类型:字符串
- 字段名:id(样本ID),数据类型:字符串
数据拆分:
- 拆分名称:test,字节数:25511505.0,样本数量:684
- 拆分名称:validation,字节数:24579157.0,样本数量:635
下载大小:49765393,数据集总大小:50090662.0
- 配置名称:fleurs
特征字段:
- 字段名:sentence_id(句子ID),数据类型:int32
- 字段名:num_samples(采样点数),数据类型:int32
- 字段名:audio(音频),数据类型:
音频:采样率为16000Hz
- 字段名:transcription(转录文本),数据类型:字符串
- 字段名:raw_transcription(原始转录文本),数据类型:字符串
- 字段名:gender(性别),数据类型:
分类标签:名称对应如下:
'0': male(男性)
'1': female(女性)
'2': other(其他)
- 字段名:lang_id(语言ID),数据类型:
分类标签:名称对应如下:
'0': af_za
'1': am_et
'2': ar_eg
'3': as_in
'4': ast_es
'5': az_az
'6': be_by
'7': bg_bg
'8': bn_in
'9': bs_ba
'10': ca_es
'11': ceb_ph
'12': ckb_iq
'13': cmn_hans_cn
'14': cs_cz
'15': cy_gb
'16': da_dk
'17': de_de
'18': el_gr
'19': en_us
'20': es_419
'21': et_ee
'22': fa_ir
'23': ff_sn
'24': fi_fi
'25': fil_ph
'26': fr_fr
'27': ga_ie
'28': gl_es
'29': gu_in
'30': ha_ng
'31': he_il
'32': hi_in
'33': hr_hr
'34': hu_hu
'35': hy_am
'36': id_id
'37': ig_ng
'38': is_is
'39': it_it
'40': ja_jp
'41': jv_id
'42': ka_ge
'43': kam_ke
'44': kea_cv
'45': kk_kz
'46': km_kh
'47': kn_in
'48': ko_kr
'49': ky_kg
'50': lb_lu
'51': lg_ug
'52': ln_cd
'53': lo_la
'54': lt_lt
'55': luo_ke
'56': lv_lv
'57': mi_nz
'58': mk_mk
'59': ml_in
'60': mn_mn
'61': mr_in
'62': ms_my
'63': mt_mt
'64': my_mm
'65': nb_no
'66': ne_np
'67': nl_nl
'68': nso_za
'69': ny_mw
'70': oc_fr
'71': om_et
'72': or_in
'73': pa_in
'74': pl_pl
'75': ps_af
'76': pt_br
'77': ro_ro
'78': ru_ru
'79': sd_in
'80': sk_sk
'81': sl_si
'82': sn_zw
'83': so_so
'84': sr_rs
'85': sv_se
'86': sw_ke
'87': ta_in
'88': te_in
'89': tg_tj
'90': th_th
'91': tr_tr
'92': uk_ua
'93': umb_ao
'94': ur_pk
'95': uz_uz
'96': vi_vn
'97': wo_sn
'98': xh_za
'99': yo_ng
'100': yue_hant_hk
'101': zu_za
'102': all
- 字段名:language(语言),数据类型:字符串
- 字段名:lang_group_id(语言组ID),数据类型:
分类标签:名称对应如下:
'0': western_european_we(西欧语系)
'1': eastern_european_ee(东欧语系)
'2': central_asia_middle_north_african_cmn(中亚、中东、北非及普通话语系)
'3': sub_saharan_african_ssa(撒哈拉以南非洲语系)
'4': south_asian_sa(南亚语系)
'5': south_east_asian_sea(东南亚语系)
'6': chinese_japanase_korean_cjk(中、日、韩语系)
- 字段名:translation(翻译文本),数据类型:字符串
- 字段名:raw_translation(原始翻译文本),数据类型:字符串
数据拆分:
- 拆分名称:test,字节数:545153848.0,样本数量:650
- 拆分名称:validation,字节数:217102833.0,样本数量:266
下载大小:758218618,数据集总大小:762256681.0
配置信息:
- 配置名称:covost2,数据文件:
- 拆分test:路径为covost2/test-*
- 拆分validation:路径为covost2/validation-*
- 配置名称:fleurs,数据文件:
- 拆分test:路径为fleurs/test-*
- 拆分validation:路径为fleurs/validation-*
提供机构:
japanese-asr


