Software Heritage Graph Dataset

这是软件遗产图数据集: 软件遗产档案的完全重复的Merkle DAG表示。数据集将文件内容标识符，源代码目录，版本控制系统 (VCS) 链接在一起，随着时间的推移进行跟踪演变，直到软件遗产在定期爬网期间观察到VCS存储库的完整状态。数据集的内容来自主要开发forges (包括GitHub和GitLab)，FOSS发行版 (例如Debian) 和特定于语言的软件包管理器 (例如PyPI)。还包括爬行信息，提供有关在野外观察到所有存档的源代码工件的时间和位置的时间戳。This is the Software Heritage Graph Dataset: a fully replicated Merkle DAG representation of the Software Heritage Archive. The dataset links file content identifiers, source code directories, and version control systems (VCS) together, tracking their evolutionary changes over time until the Software Heritage Archive observes the complete state of VCS repositories during regular crawls. The content of the dataset originates from major development forges (including GitHub and GitLab), free and open-source software (FOSS) distributions such as Debian, and language-specific software package managers such as PyPI. It also includes crawl metadata, providing timestamps regarding the time and location where all archived source code artifacts were observed in the wild.

搜集汇总

背景与挑战

背景概述

该数据集是软件遗产档案的Merkle DAG图表示，通过链接文件内容、源代码目录和版本控制系统来跟踪软件演变，数据源自GitHub、GitLab、Debian和PyPI等平台，并包含爬行时间戳。由雅典经济与商业大学等机构于2020年发布。