akkp69000

Context Scientific papers, as well as other types of documents, can be identified by a set of keywords. Typically, authors are free to choose their Keywords. When authors decide keywords, we called them Authors' Keywords (AK) Sometimes, keywords are imposed, limited or infered by using algorithms. KeyWordsPlus © (KP) try to use information from the bibliographic references of an article to infere keywords. Content This dataset contains information about AK and KP of 69.000 articles. All the articles have been retrieved from Web of Science (WOS): https://www.webofknowledge.com The data is splitted into three different collections: Raw: The raw data, as comes from WoS. Document are distributed over CSV documents. Columns "DE" and "ID" referers to AK and KP, respectively. filtered: We've removed all the articles which don't contain information about AK and KP at the same time. pre_processed: We have cleaned keywords to remove special character, and we have lowercased and stemmed all the keywords. In filtered and pre_processed, you will find two text documents: "ak.txt" and "kp.txt", every line of these documents referers to the same article. So for example, the article number 8 have the following keywords: AK: Automated knowledge assessment; concept map; linking phrase; semantic analysis KP: SCIENCE After pre-processing, the article number 8 have the following keywords: - AK: automknowledgassess;conceptmap;linkphrase;semant_analysi - KP: scienc Acknowledgements We want to thank Web of Science for giving access to it's database.学术论文及其他类型文献均可通过一组关键词实现标识。通常而言，作者可自主选定关键词，此类由作者自行确定的关键词被称为作者关键词（Authors' Keywords，AK）。部分关键词则通过算法进行强制指定、限定或推导生成。KeyWordsPlus®（KP）则依托文献的参考文献信息来推导关键词。 本数据集涵盖69000篇文献的作者关键词与KeyWordsPlus®关键词相关信息。所有文献均检索自Web of Science（WOS）平台：https://www.webofknowledge.com。数据划分为三个独立集合： 1. 原始数据集（Raw）：直接从WOS导出的原始数据，文献以CSV文件分发存储，其中列"DE"与"ID"分别对应作者关键词与KeyWordsPlus®关键词。 2. 过滤后数据集（filtered）：已移除未同时包含作者关键词与KeyWordsPlus®关键词的文献。 3. 预处理后数据集（pre_processed）：已完成关键词清洗操作，去除特殊字符，并将所有关键词转换为小写形式且完成词干化。 在过滤后与预处理后的数据集内，均包含两个文本文件："ak.txt"与"kp.txt"，二者的各行内容分别对应同一篇文献。例如第8篇文献的原始关键词如下： AK：自动化知识评估；概念图；连接短语；语义分析 KP：SCIENCE 经预处理后，该文献的关键词变为： - AK：automknowledgassess;conceptmap;linkphrase;semant_analysi - KP：scienc 致谢 感谢Web of Science授权访问其数据库。