有没有相关的论文或文献参考？
这个数据集是基于什么背景创建的？
数据集的作者是谁？
能帮我联系到这个数据集的作者吗？
这个数据集如何下载？
Semantic Drone Dataset|无人机数据集|语义分析数据集
收藏github2024-06-20 更新2024-06-21 收录
下载链接：
https://github.com/Angel3245/pix2pix_image-generation
下载链接
链接失效反馈资源简介：
该数据集专注于城市场景的语义理解，用于提高自主无人机飞行和着陆过程的安全性。数据集包含超过20个房屋的鸟瞰图，图像大小为400x600，由高分辨率相机在5至30米的高度拍摄。
This dataset focuses on the semantic understanding of urban scenes, aimed at enhancing the safety of autonomous drone navigation and landing processes. It comprises over 20 aerial views of houses, with image dimensions of 400x600 pixels, captured by high-resolution cameras at altitudes ranging from 5 to 30 meters.
创建时间：
2024-06-20
原始信息汇总
数据集描述
- 名称: Semantic Drone Dataset (TU-Graz)
- 来源: Semantic Drone Dataset
- 用途: 用于训练和评估图像到图像翻译模型，专注于城市场景的语义理解，以提高自主无人机飞行和着陆过程的安全性。
- 特点:
- 包含超过20栋房屋的鸟瞰图。
- 图像采集高度为5至30米。
- 使用高分辨率相机，图像尺寸为400x600。
评估指标
- PSNR: 峰值信噪比，用于衡量生成图像与真实图像的质量，PSNR值越高，图像质量越好。
- SSIM: 结构相似性指数，用于衡量生成图像与真实图像的相似性，考虑结构信息、亮度和对比度的变化。
- Cosine Similarity: 余弦相似度，通过计算两个图像特征向量之间的余弦角来衡量图像相似性，相似度越高，图像越相似。
- FCN-Score: 使用全卷积网络评估生成图像的分割性能，FCN-Score越高，分割质量越好。
- Qualitative Analysis: 定性分析，通过视觉检查生成图像的逼真度，包括与真实图像的并排比较和人类观察者的评估。
AI搜集汇总
数据集介绍
构建方式
在构建Semantic Drone Dataset时，研究团队采用了高分辨率相机，从无人机在5至30米高空拍摄的视角，捕捉了超过20栋房屋的鸟瞰图像。这些图像以400x600的分辨率记录，旨在为城市场景的语义理解提供丰富的视觉数据，从而提升自主无人机飞行和着陆过程的安全性。
特点
Semantic Drone Dataset的显著特点在于其高分辨率和特定视角的图像采集，这使得数据集在城市环境中的语义分析方面具有极高的应用价值。此外，该数据集还包含了多种量化评估指标（如PSNR、SSIM、Cosine Similarity和FCN-Score），这些指标为模型的性能评估提供了全面的参考。
使用方法
使用Semantic Drone Dataset时，用户首先需导航至项目目录并创建一个conda环境。随后，通过加载和预处理图像数据，用户可以训练Pix2Pix模型中的生成器和判别器，利用对抗损失和重构损失优化模型。训练过程中，模型会定期保存检查点以供后续评估。最终，通过PSNR、SSIM、Cosine Similarity和FCN-Score等指标，用户可以对生成的图像进行量化评估，并通过视觉检查进行定性分析。
背景与挑战
背景概述
Semantic Drone Dataset，由TU-Graz机构创建，专注于城市场景的语义理解，旨在提升无人机的自主飞行和着陆安全性。该数据集包含超过20栋房屋的鸟瞰图像，采集高度为5至30米，图像分辨率为400x600。其核心研究问题在于通过高分辨率图像实现对城市环境的精确语义分割，从而为无人机导航提供可靠数据支持。此数据集对无人机技术领域的影响深远，特别是在提升飞行安全性和环境感知能力方面。
当前挑战
Semantic Drone Dataset在构建过程中面临的主要挑战包括高分辨率图像的采集与处理，以及确保数据集的多样性和代表性。此外，该数据集在应用中的挑战在于如何有效地将图像转换为语义信息，以支持无人机的自主决策。具体挑战包括：1) 图像到图像转换模型的训练，需平衡生成图像的逼真度与语义准确性；2) 评估指标的选择，如PSNR、SSIM、Cosine Similarity和FCN-Score，需确保这些指标能全面反映模型的性能；3) 数据集的更新与扩展，以适应不断变化的城市环境和无人机技术的发展。
常用场景
经典使用场景
在无人机自主飞行与着陆过程中，Semantic Drone Dataset 被广泛应用于图像到图像的翻译任务。通过Pix2Pix模型，该数据集能够将输入的无人机视角图像转换为高分辨率的现实图像，从而提升无人机在复杂城市环境中的导航与着陆安全性。这一应用场景不仅优化了无人机的视觉感知能力，还为后续的图像处理与分析提供了坚实的基础。
衍生相关工作
基于Semantic Drone Dataset，研究者们开发了多种图像翻译与语义分割模型，如Pix2Pix、CycleGAN等，这些模型在无人机视觉感知与导航领域取得了显著成果。此外，该数据集还激发了大量关于无人机自主飞行与着陆的研究，推动了计算机视觉与机器人技术的交叉融合。这些衍生工作不仅丰富了学术研究的内容，还为无人机技术的实际应用提供了新的思路和方法。
数据集最近研究
最新研究方向
在无人机自主飞行与着陆安全领域，Semantic Drone Dataset的最新研究方向主要集中在图像到图像翻译技术的应用上。通过Pix2Pix模型，研究者们致力于将输入图像转换为高度逼真的输出图像，以提升无人机在复杂城市环境中的导航与着陆精度。这一研究不仅推动了图像处理技术的边界，还为无人机在实际应用中的安全性提供了新的保障。此外，该数据集的量化评估指标如PSNR、SSIM、Cosine Similarity和FCN-Score，以及定性分析方法，为模型的性能评估提供了全面而深入的视角，进一步促进了该领域的技术进步。
以上内容由AI搜集并总结生成
数据主题
5,000+
优质数据集
54 个
任务类型
进入经典数据集
热门数据集
aqcat25
<h1 align="center" style="font-size: 36px;"> <span style="color: #FFD700;">AQCat25 Dataset:</span> Unlocking spin-aware, high-fidelity machine learning potentials for heterogeneous catalysis </h1>  This repository contains the **AQCat25 dataset**. AQCat25-EV2 models can be accessed [here](https://huggingface.co/SandboxAQ/aqcat25-ev2). The AQCat25 dataset provides a large and diverse collection of **13.5 million** DFT calculation trajectories, encompassing approximately 5K materials and 47K intermediate-catalyst systems. It is designed to complement existing large-scale datasets by providing calculations at **higher fidelity** and including critical **spin-polarized** systems, which are essential for accurately modeling many industrially relevant catalysts. Please see our [website](https://www.sandboxaq.com/aqcat25) and [paper](https://cdn.prod.website-files.com/622a3cfaa89636b753810f04/68ffc1e7c907b6088573ba8c_AQCat25.pdf) for more details about the impact of the dataset and [models](https://huggingface.co/SandboxAQ/aqcat25-ev2). ## 1. AQCat25 Dataset Details This repository uses a hybrid approach, providing lightweight, queryable Parquet files for each split alongside compressed archives (`.tar.gz`) of the raw ASE database files. More details can be found below. ### Queryable Metadata (Parquet Files) A set of Parquet files provides a "table of contents" for the dataset. They can be loaded directly with the `datasets` library for fast browsing and filtering. Each file contains the following columns: | Column Name | Data Type | Description | Example | | :--- | :--- | :--- | :--- | | `frame_id` | string | **Unique ID for this dataset**. Formatted as `database_name::index`. | `data.0015.aselmdb::42` | | `adsorption_energy`| float | **Key Target**. The calculated adsorption energy in eV. | -1.542 | | `total_energy` | float | The raw total energy of the adslab system from DFT (in eV). | -567.123 | | `fmax` | float | The maximum force magnitude on any single atom in eV/Å. | 0.028 | | `is_spin_off` | boolean | `True` if the system is non-magnetic (VASP ISPIN=1). | `false` | | `mag` | float | The total magnetization of the system (µB). | 32.619 | | `slab_id` | string | Identifier for the clean slab structure. | `mp-1216478_001_2_False` | | `adsorbate` | string | SMILES or chemical formula of the adsorbate. | `*NH2N(CH3)2` | | `is_rerun` | boolean | `True` if the calculation is a continuation. | `false` | | `is_md` | boolean | `True` if the frame is from a molecular dynamics run. | `false` | | `sid` | string | The original system ID from the source data. | `vadslabboth_82` | | `fid` | integer | The original frame index (step number) from the source VASP calculation. | 0 | --- #### Understanding `frame_id` and `fid` | Field | Purpose | Example | | :--- | :--- | :--- | | `fid` | **Original Frame Index**: This is the step number from the original VASP relaxation (`ionic_steps`). It tells you where the frame came from in its source simulation. | `4` (the 5th frame of a specific VASP run) | | `frame_id` | **Unique Dataset Pointer**: This is a new ID created for this specific dataset. It tells you exactly which file (`data.0015.aselmdb`) and which row (`101`) to look in to find the full atomic structure. | `data.0015.aselmdb::101` | --- ## Downloadable Data Archives The full, raw data for each split is available for download in compressed `.tar.gz` archives. The table below provides direct download links. The queryable Parquet files for each split can be loaded directly using the `datasets` library as shown in the "Example Usage" section. The data currently available for download (totaling ~11.1M frames, as listed in the table below) is the initial dataset version (v1.0) released on September 10, 2025. The 13.5M frame count mentioned in our paper and the introduction includes additional data used to rebalance non-magnetic element systems and add a low-fidelity spin-on dataset. These new data splits will be added to this repository soon. | Split Name | Structures | Archive Size | Download Link | | :--- | :--- | :--- | :--- | | ***In-Domain (ID)*** | | | | | Train | `7,386,750` | `23.8 GB` | [`train_id.tar.gz`](https://huggingface.co/datasets/SandboxAQ/aqcat25-dataset/resolve/main/train_id.tar.gz) | | Validation | `254,498` | `825 MB` | [`val_id.tar.gz`](https://huggingface.co/datasets/SandboxAQ/aqcat25-dataset/resolve/main/val_id.tar.gz) | | Test | `260,647` | `850 MB` | [`test_id.tar.gz`](https://huggingface.co/datasets/SandboxAQ/aqcat25-dataset/resolve/main/test_id.tar.gz) | | Slabs | `898,530` | `2.56 GB` | [`id_slabs.tar.gz`](https://huggingface.co/datasets/SandboxAQ/aqcat25-dataset/resolve/main/id_slabs.tar.gz) | | ***Out-of-Distribution (OOD) Validation*** | | | | | OOD Ads (Val) | `577,368` | `1.74 GB` | [`val_ood_ads.tar.gz`](https://huggingface.co/datasets/SandboxAQ/aqcat25-dataset/resolve/main/val_ood_ads.tar.gz) | | OOD Materials (Val) | `317,642` | `963 MB` | [`val_ood_mat.tar.gz`](https://huggingface.co/datasets/SandboxAQ/aqcat25-dataset/resolve/main/val_ood_mat.tar.gz) | | OOD Both (Val) | `294,824` | `880 MB` | [`val_ood_both.tar.gz`](https://huggingface.co/datasets/SandboxAQ/aqcat25-dataset/resolve/main/val_ood_both.tar.gz) | | OOD Slabs (Val) | `28,971` | `83 MB` | [`val_ood_slabs.tar.gz`](https://huggingface.co/datasets/SandboxAQ/aqcat25-dataset/resolve/main/val_ood_slabs.tar.gz) | | ***Out-of-Distribution (OOD) Test*** | | | | | OOD Ads (Test) | `346,738` | `1.05 GB` | [`test_ood_ads.tar.gz`](https://huggingface.co/datasets/SandboxAQ/aqcat25-dataset/resolve/main/test_ood_ads.tar.gz) | | OOD Materials (Test) | `315,931` | `993 MB` | [`test_ood_mat.tar.gz`](https://huggingface.co/datasets/SandboxAQ/aqcat25-dataset/resolve/main/test_ood_mat.tar.gz) | | OOD Both (Test) | `355,504` | `1.1 GB` | [`test_ood_both.tar.gz`](https://huggingface.co/datasets/SandboxAQ/aqcat25-dataset/resolve/main/test_ood_both.tar.gz) | | OOD Slabs (Test) | `35,936` | `109 MB` | [`test_ood_slabs.tar.gz`](https://huggingface.co/datasets/SandboxAQ/aqcat25-dataset/resolve/main/test_ood_slabs.tar.gz) | --- ## 2. Dataset Usage Guide This guide outlines the recommended workflow for accessing and querying the AQCat25 dataset. ### 2.1 Initial Setup Before you begin, you need to install the necessary libraries and authenticate with Hugging Face. This is a one-time setup. ```bash pip install datasets pandas ase tqdm requests huggingface_hub ase-db-backends ``` **1. Create a Hugging Face Account:** If you don't have one, create an account at [huggingface.co](https://huggingface.co/join). **2. Create an Access Token:** Navigate to your **Settings -> Access Tokens** page or click [here](https://huggingface.co/settings/tokens). Create a new token with at least **`read`** permissions. Copy this token to your clipboard. **3. Log in via the Command Line:** Open your terminal and run the following command: ```bash hf auth login ``` ### 2.2 Get the Helper Scripts You may copy the scripts directly from this repository, or download them by running the following in your local python environment: ```python from huggingface_hub import snapshot_download snapshot_download( repo_id="SandboxAQ/aqcat25", repo_type="dataset", allow_patterns=["scripts/*", "README.md"], local_dir="./aqcat25" ) ``` This will create a local folder named aqcat25 containing the scripts/ directory. ### 2.3 Download Desired Dataset Splits Data splits may be downloaded directly via the Hugging Face UI, or via the `download_split.py` script (found in `aqcat25/scripts/`). ```bash python aqcat25/scripts/download_split.py --split val_id ``` This will download `val_id.tar.gz` and extract it to a new folder named `aqcat_data/val_id/`. ### 2.4 Query the Dataset Use the `query_aqcat.py` script to filter the dataset and extract the specific atomic structures you need. It first queries the metadata on the Hub and then extracts the full structures from your locally downloaded files. **Example 1: Find all CO and OH structures in the test set:** ```bash python aqcat25/scripts/query_aqcat.py \ --split test_id \ --adsorbates "*CO" "*OH" \ --data-root ./aqcat_data/test_id ``` **Example 2: Find structures on metal slabs with low adsorption energy:** ```bash python aqcat25/scripts/query_aqcat.py \ --split val_ood_both \ --max-energy -2.0 \ --material-type nonmetal \ --magnetism magnetic \ --data-root ./aqcat_data/val_ood_both \ --output-file low_energy_metals.extxyz ``` **Example 3: Find CO on slabs containing both Ni AND Se with adsorption energy between -2.5 and -1.5 eV with a miller index of 011** ```bash python aqcat25/scripts/query_aqcat.py \ --split val_ood_ads \ --adsorbates "*COCH2OH" \ --min-energy -2.5 \ --max-energy -1.5 \ --contains-elements "Ni" "Se" \ --element-filter-mode all \ --facet 011 \ --data-root ./aqcat_data/val_ood_ads \ --output-file COCH2OH_on_ni_and_se.extxyz ``` --- ## 3. How to Cite If you use the AQCat25 dataset or the models in your research, please cite the following paper: ``` Omar Allam, Brook Wander, & Aayush R. Singh. (2025). AQCat25: Unlocking spin-aware, high-fidelity machine learning potentials for heterogeneous catalysis. arXiv preprint arXiv:XXXX.XXXXX. ``` ### BibTeX Entry ```bibtex @article{allam2025aqcat25, title={{AQCat25: Unlocking spin-aware, high-fidelity machine learning potentials for heterogeneous catalysis}}, author={Allam, Omar and Wander, Brook and Singh, Aayush R}, journal={arXiv preprint arXiv:2510.22938}, year={2025}, eprint={2510.22938}, archivePrefix={arXiv}, primaryClass={cond-mat.mtrl-sci} } ```
魔搭社区 收录
波士顿房价数据集
波士顿房价数据集是一个经典的机器学习数据集，通常用于回归任务，尤其是房价预测。下方文档中有所有字段顺序的描述。
阿里云天池 收录
HaluMem-Medium, HaluMem-Long
HaluMem数据集旨在评估记忆系统中存在的幻觉现象。该数据集由MemTensor (上海) 科技和哈尔滨工程大学联合构建，包含约15,000个记忆点，以及超过3,400个评估查询。每个用户的平均对话轮数为1,000轮以上，最长对话长度可达百万级Tokens，能够全面评估不同上下文规模和任务复杂度下的幻觉行为。
arXiv 收录
中国区域交通网络数据集
该数据集包含中国各区域的交通网络信息，包括道路、铁路、航空和水路等多种交通方式的网络结构和连接关系。数据集详细记录了各交通节点的位置、交通线路的类型、长度、容量以及相关的交通流量信息。
data.stats.gov.cn 收录
中国交通事故深度调查（CIDAS）数据集
交通事故深度调查数据通过采用科学系统方法现场调查中国道路上实际发生交通事故相关的道路环境、道路交通行为、车辆损坏、人员损伤信息，以探究碰撞事故中车损和人伤机理。目前已积累深度调查事故10000余例，单个案例信息包含人、车 、路和环境多维信息组成的3000多个字段。该数据集可作为深入分析中国道路交通事故工况特征，探索事故预防和损伤防护措施的关键数据源，为制定汽车安全法规和标准、完善汽车测评试验规程、
北方大数据交易中心 收录