strombergnlp/itu_faroese_danish
收藏Hugging Face2022-07-01 更新2024-03-04 收录
下载链接:
https://hf-mirror.com/datasets/strombergnlp/itu_faroese_danish
下载链接
链接失效反馈官方服务:
资源简介:
---
annotations_creators:
- expert-generated
language_creators:
- found
language:
- da
- fo
license:
- cc-by-4.0
multilinguality:
- multilingual
pretty_name: ITU Faroese Danish parallel text
size_categories:
- 1K<n<10K
source_datasets:
- original
task_categories:
- translation
task_ids: []
---
## Table of Contents
- [Dataset Description](#dataset-description)
- [Dataset Summary](#dataset-summary)
- [Supported Tasks](#supported-tasks-and-leaderboards)
- [Languages](#languages)
- [Dataset Structure](#dataset-structure)
- [Data Instances](#data-instances)
- [Data Fields](#data-instances)
- [Data Splits](#data-instances)
- [Dataset Creation](#dataset-creation)
- [Curation Rationale](#curation-rationale)
- [Source Data](#source-data)
- [Annotations](#annotations)
- [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
- [Social Impact of Dataset](#social-impact-of-dataset)
- [Discussion of Biases](#discussion-of-biases)
- [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
- [Dataset Curators](#dataset-curators)
- [Licensing Information](#licensing-information)
- [Citation Information](#citation-information)
## Dataset Description
- **Homepage:**
- **Repository:**
- **Paper:** [https://arxiv.org/abs/2206.08727](https://arxiv.org/abs/2206.08727)
- **Leaderboard:**
- **Point of Contact:** [Leon Derczynski](https://github.com/leondz)
### Dataset Summary
This is a native-speaker-generated parallel corpus of Faroese and Danish
### Supported Tasks and Leaderboards
*
### Languages
* Danish
* Faroese
## Dataset Structure
### Data Instances
3995 parallel sentences
### Data Fields
* `id`: the sentence pair ID, `string`
* `origin`: the original sentence identifier text, `string`
* `fo`: the Faroese text, `string`
* `da`: the Danish text, `string`
### Data Splits
Monolithic
## Dataset Creation
### Curation Rationale
To gather a broad range of topics about the Faroes and the rest of the world, to enable a general-purpose Faroese:Danish translation system
### Source Data
#### Initial Data Collection and Normalization
* EUROparl Danish
* Dimmaletting, Faroese newspaper
* Tatoeba Danish / Faroese
#### Who are the source language producers?
### Annotations
#### Annotation process
No annotations
#### Who are the annotators?
Two Faroese native speakers, one male one female, in their 20s, masters degrees, living in Denmark
### Personal and Sensitive Information
None due to the sources used
## Considerations for Using the Data
### Social Impact of Dataset
### Discussion of Biases
[Needs More Information]
### Other Known Limitations
[Needs More Information]
## Additional Information
### Dataset Curators
This collection of Faroese is curated by Leon Derczynski
### Licensing Information
Creative Commons Attribution 4.0
### Citation Information
```
```
提供机构:
strombergnlp原始信息汇总
数据集概述
- 名称: ITU Faroese Danish parallel text
- 语言:
- 法罗语 (fo)
- 丹麦语 (da)
- 许可证: cc-by-4.0
- 多语言性: 多语言
- 规模: 1K<n<10K
- 来源: 原始数据
- 任务类别: 翻译
数据集结构
- 数据实例: 3995个平行句子
- 数据字段:
id: 句子对ID,stringorigin: 原始句子标识文本,stringfo: 法罗语文本,stringda: 丹麦语文本,string
- 数据分割: 整体
数据集创建
- 采集理由: 收集关于法罗群岛及世界其他地区的广泛主题,以支持通用法罗语-丹麦语翻译系统
- 源数据:
- EUROparl Danish
- Dimmaletting, 法罗语报纸
- Tatoeba Danish / Faroese
- 注释:
- 注释过程: 无注释
- 注释者: 两名法罗语母语者,一男一女,20多岁,硕士学位,居住在丹麦
使用数据注意事项
- 个人和敏感信息: 由于使用的数据源,无个人和敏感信息
附加信息
- 数据集策展人: Leon Derczynski
- 许可证信息: 创意共享署名4.0国际许可
- 引用信息: [需要更多信息]



