alvations/iate-2016

IATE 2016数据集是欧洲互动术语库（Inter-Active Terminology for Europe）在2016年4月25日的快照版本，为欧盟机构和实体的官方多语言术语数据库。该数据集包括单语言配置，覆盖所有欧盟官方语言（约24种），以及四个预对齐的双语子集（英语-德语、英语-法语、英语-芬兰语、英语-捷克语）。数据行数从单语言的6,148,883行到双语子集的数万至数十万行不等，总规模在100万到1000万行之间。每条记录包含术语ID、语言代码、术语文本、术语类型（如完整形式）和可靠性代码（1-5级）。数据集适用于翻译、特征提取和标记分类等自然语言处理任务，支持术语对齐和多语言分析。数据遵循EC Decision 2011/833/EU许可证，允许商业和非商业重用，但需保留来源归属。IATE 2016 dataset is a snapshot of the Inter-Active Terminology for Europe from 2016-04-25, which is the official multilingual terminology database of the EU institutions and bodies. It includes a monolingual configuration covering all EU official languages (approximately 24), and four pre-aligned bilingual subsets (English-German, English-French, English-Finnish, English-Czech). The row counts range from 6,148,883 for monolingual to hundreds of thousands for bilingual subsets, with an overall size between 1M and 10M rows. Each record contains term ID, language code, term text, term type (e.g., fullForm), and reliability code (1-5). The dataset is suitable for NLP tasks such as translation, feature extraction, and token classification, supporting terminology alignment and multilingual analysis. It is licensed under EC Decision 2011/833/EU, allowing reuse for both commercial and non-commercial purposes with required source attribution.