five

strombergnlp/itu_faroese_danish

收藏
Hugging Face2022-07-01 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/strombergnlp/itu_faroese_danish
下载链接
链接失效反馈
官方服务:
资源简介:
--- annotations_creators: - expert-generated language_creators: - found language: - da - fo license: - cc-by-4.0 multilinguality: - multilingual pretty_name: ITU Faroese Danish parallel text size_categories: - 1K<n<10K source_datasets: - original task_categories: - translation task_ids: [] --- ## Table of Contents - [Dataset Description](#dataset-description) - [Dataset Summary](#dataset-summary) - [Supported Tasks](#supported-tasks-and-leaderboards) - [Languages](#languages) - [Dataset Structure](#dataset-structure) - [Data Instances](#data-instances) - [Data Fields](#data-instances) - [Data Splits](#data-instances) - [Dataset Creation](#dataset-creation) - [Curation Rationale](#curation-rationale) - [Source Data](#source-data) - [Annotations](#annotations) - [Personal and Sensitive Information](#personal-and-sensitive-information) - [Considerations for Using the Data](#considerations-for-using-the-data) - [Social Impact of Dataset](#social-impact-of-dataset) - [Discussion of Biases](#discussion-of-biases) - [Other Known Limitations](#other-known-limitations) - [Additional Information](#additional-information) - [Dataset Curators](#dataset-curators) - [Licensing Information](#licensing-information) - [Citation Information](#citation-information) ## Dataset Description - **Homepage:** - **Repository:** - **Paper:** [https://arxiv.org/abs/2206.08727](https://arxiv.org/abs/2206.08727) - **Leaderboard:** - **Point of Contact:** [Leon Derczynski](https://github.com/leondz) ### Dataset Summary This is a native-speaker-generated parallel corpus of Faroese and Danish ### Supported Tasks and Leaderboards * ### Languages * Danish * Faroese ## Dataset Structure ### Data Instances 3995 parallel sentences ### Data Fields * `id`: the sentence pair ID, `string` * `origin`: the original sentence identifier text, `string` * `fo`: the Faroese text, `string` * `da`: the Danish text, `string` ### Data Splits Monolithic ## Dataset Creation ### Curation Rationale To gather a broad range of topics about the Faroes and the rest of the world, to enable a general-purpose Faroese:Danish translation system ### Source Data #### Initial Data Collection and Normalization * EUROparl Danish * Dimmaletting, Faroese newspaper * Tatoeba Danish / Faroese #### Who are the source language producers? ### Annotations #### Annotation process No annotations #### Who are the annotators? Two Faroese native speakers, one male one female, in their 20s, masters degrees, living in Denmark ### Personal and Sensitive Information None due to the sources used ## Considerations for Using the Data ### Social Impact of Dataset ### Discussion of Biases [Needs More Information] ### Other Known Limitations [Needs More Information] ## Additional Information ### Dataset Curators This collection of Faroese is curated by Leon Derczynski ### Licensing Information Creative Commons Attribution 4.0 ### Citation Information ``` ```
提供机构:
strombergnlp
原始信息汇总

数据集概述

  • 名称: ITU Faroese Danish parallel text
  • 语言:
    • 法罗语 (fo)
    • 丹麦语 (da)
  • 许可证: cc-by-4.0
  • 多语言性: 多语言
  • 规模: 1K<n<10K
  • 来源: 原始数据
  • 任务类别: 翻译

数据集结构

  • 数据实例: 3995个平行句子
  • 数据字段:
    • id: 句子对ID, string
    • origin: 原始句子标识文本, string
    • fo: 法罗语文本, string
    • da: 丹麦语文本, string
  • 数据分割: 整体

数据集创建

  • 采集理由: 收集关于法罗群岛及世界其他地区的广泛主题,以支持通用法罗语-丹麦语翻译系统
  • 源数据:
    • EUROparl Danish
    • Dimmaletting, 法罗语报纸
    • Tatoeba Danish / Faroese
  • 注释:
    • 注释过程: 无注释
    • 注释者: 两名法罗语母语者,一男一女,20多岁,硕士学位,居住在丹麦

使用数据注意事项

  • 个人和敏感信息: 由于使用的数据源,无个人和敏感信息

附加信息

  • 数据集策展人: Leon Derczynski
  • 许可证信息: 创意共享署名4.0国际许可
  • 引用信息: [需要更多信息]
二维码
社区交流群
二维码
科研交流群
商业服务