iisc-aim/BMD-45
收藏资源简介:
--- pretty_name: BMD-45 (Bengaluru Mobility Dataset) license: cc-by-4.0 tags: - computer-vision - object-detection - traffic - vehicles - india - cctv - bengaluru - urban - intelligent-transportation-systems task_categories: - object-detection task_ids: - vehicle-detection language: - und annotations_creators: - crowd-sourced source_datasets: [] size_categories: - 10K<n<100K dataset_info: features: - name: image dtype: image - name: objects sequence: - name: bbox sequence: float32 - name: categories dtype: class_label: names: - Hatchback - Sedan - SUV - MUV - Bus - Truck - Three-wheeler - Two-wheeler - LCV - Mini-bus - Tempo-traveller - Bicycle - Van - Other splits: - name: train num_examples: 35792 - name: val num_examples: 10194 configs: - config_name: default data_files: - split: train path: "BMD-45-Train/**" - split: val path: "BMD-45-Val/**" --- # BMD-45: Bengaluru Mobility Dataset **A large-scale CCTV vehicle detection benchmark for Indian urban traffic** --- ## Dataset Summary **BMD-45** is a large-scale, India-specific vehicle detection dataset captured from **3,679 operational CCTV cameras** across Bengaluru — one of the world's most traffic-congested megacities. | Statistic | Value | | ----------------- | ----------------------------------- | | Total images | **45,986** (1920×1080 RGB) | | Total annotations | **≈ 481,947** bounding boxes | | Vehicle classes | **14** fine-grained categories | | Camera sources | **3,679** Safe City CCTV cameras | | Train split | 35,792 images / 375,003 annotations | | Val split | 10,194 images / 106,944 annotations | | Test split | 5,110 images (annotations withheld) | | Image resolution | 1920 × 1080 px | | Annotation format | COCO JSON | BMD-45 addresses critical gaps in existing traffic datasets: **scale**, **camera-view diversity**, and **fine-grained Indian vehicle taxonomy** — all absent from prior fixed-camera benchmarks (UA-DETRAC, TrafficCAM, IDD). The dataset captures dense, heterogeneous, and unstructured traffic characteristic of Indian urban environments, with images sampled from long-duration CCTV recordings using **spatial and temporal diversity criteria** and **difficulty scoring** to prioritize challenging, high-information frames. ## Attribution More technical details about the dataset and models are available in our Technical Report. If you use these datasets or models, kindly cite the following: ```bibtex @inproceedings{bmd45_2026, title = {BMD-45: Bengaluru Mobility Dataset for Large-Scale Vehicle Detection from Urban CCTV}, author = {Akash Sharma and Chinmay Mhatre and Sankalp Gawali and Ruthvik Bokkasam and Brij Kishore and Vishwajeet Pattanaik and Tarun Rambha and Abdul R. Pinjari and Vijay Kovvali and Anirban Chakraborty and Punit Rathore and Raghu Krishnapuram and Yogesh Simmhan}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Findings (CVPRF26)}, year = {2026} } ``` ## Dataset Structure The dataset follows the folder structure described below. ### **1. BMD-45-Train/** Contains **35,792 images** (~78% of the dataset) used for training. - `**images_000/`** through `**images_007/**` – Training images organized into subfolders for convenience. - `images_000/*` – Training images (`41.png`, `47.png`, …). Each image filename is unique across the entire dataset. - `images_001/*`, etc. – Additional subfolders following the same structure. - `**_annotations.coco.json**` – Majority Voting consensus annotations for training images in **COCO JSON format**. - `**metadata.jsonl`** – HuggingFace ImageFolder annotations (one JSON line per image). ### **2. BMD-45-Val/** Contains **10,194 images** (~22% of the dataset) used for validation. - `**images_000/`** through `**images_002/**` – Validation images organized into subfolders. - `images_000/*` – Validation images. All filenames are globally unique across both training and validation sets. - `images_001/*`, etc. – Additional subfolders following the same structure. - `**_annotations.coco.json**` – Majority Voting consensus annotations for validation images in **COCO JSON format**. - `**metadata.jsonl`** – HuggingFace ImageFolder annotations (one JSON line per image). ## Annotation JSON Schema Each `_annotations.coco.json` file follows the standard COCO structure: - `**images**` — list of image metadata `id`, `file_name`, `width`, `height` - `**annotations**` — object instances `id`, `image_id`, `category_id`, `bbox [x, y, width, height]`, `area` - `**categories**` — class taxonomy (IDs and names below) Each `metadata.jsonl` contains one JSON line per image: ```json {"file_name": "images_000/41.png", "objects": {"bbox": [[x, y, w, h], ...], "categories": [0, 2, ...]}} ``` ### Annotation Pipeline - **Source:** frames captured between 06:00 – 18:00 IST during February 2025 - **Pre-annotation:** generated using a fine-tuned **RT-DETR v2-X** model trained on ≈ 3 k expert-labeled images - **Crowdsourcing:** > 550 student volunteers corrected or validated predictions through a gamified web interface with leaderboards - **Consensus:** *majority voting* applied to derive final annotations ## Loading the Dataset ```python from datasets import load_dataset # Load from HuggingFace Hub ds = load_dataset("iisc-aim/BMD-45") # Access a sample sample = ds["train"][0] image = sample["image"] objects = sample["objects"] # {"bbox": [...], "categories": [...]} ``` ## Vehicle Classes | ID | Class Name | Description | | --- | --------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------ | | 0 | Hatchback | Small passenger cars without a protruding rear boot ("dickey"). | | 1 | Sedan | Passenger cars with a low-slung design and a separate protruding rear boot ("dickey"). | | 2 | SUV | Car-like vehicles with high ground clearance, a sturdy body, and no protruding boot. | | 3 | MUV | Large vehicles with three seating rows, combining passenger and cargo functionality. | | 4 | Bus | Large passenger vehicles used for public or private transport, including office shuttles and intercity buses. | | 5 | Truck | Heavy goods carriers with a front cabin and a rear cargo compartment. | | 6 | Three-wheeler | Compact vehicles with one front wheel and two rear wheels, featuring a covered passenger cabin. | | 7 | Two-wheeler | Motorbikes and scooters for single or double riders. Bounding boxes include both vehicle and rider. | | 8 | LCV | Lightweight goods carriers used for short- to medium-distance transport. | | 9 | Mini-bus | Shorter, compact buses with fewer seats; larger than a Tempo Traveller, often featuring a flat front. | | 10 | Tempo-traveller | Medium-sized passenger vans with tall roofs and side windows; larger than vans but smaller than minibuses, with a protruding front. | | 11 | Bicycle | Non-motorized, manually pedalled vehicles including geared, non-geared, women's, and children's cycles. Bounding boxes include both vehicle and rider. | | 12 | Van | Medium-sized vehicles for transporting goods or people, typically with a flat front and sliding side doors; smaller than Tempo Travellers. | | 13 | Other | Vehicles not covered in other classes, including agricultural, specialized, or unconventional designs. | ## Baseline Results To justify the need for BMD-45, SOTA detectors were trained **on existing datasets** and evaluated on an expert-annotated reference set of 3,000 Bengaluru CCTV images. All models trained on other datasets fall well short of practical accuracy: | Model | Training Data | mAP@50:95 | | -------------- | ------------- | --------- | | D-FINE X | IDD | 0.46 | | RT-DETRv2 X | TrafficCAM | 0.39 | | Grounding DINO | Zero-shot | 0.13 | > These are **cross-dataset baselines** (models trained on other datasets, *not* BMD-45). Results for BMD-45-trained models are reported in the paper. The following figure shows per-class AP@50:95 for selected models trained on BMD-45 and evaluated on the BMD-45 validation split:  Models trained on BMD-45 also demonstrate cross-dataset generalization to **UA-DETRAC**, **IDD**, and **TrafficCAM** using a taxonomy-aware class mapping protocol (see paper for full results). ## Cross-Dataset Generalization BMD-45-trained models are evaluated on: - **UA-DETRAC** — highway fixed-camera dataset (China, 4 classes) - **IDD** — Indian Driving Dataset (ego-centric, 9 classes) - **TrafficCAM** — Indian CCTV dataset (9 classes, 4,400 frames) A taxonomy mapping protocol merges BMD-45's 14 fine-grained classes into the coarser categories of each target dataset for fair comparison. The following figures compare per-class AP@50:95 for models trained on BMD-45 versus models trained on IDD, UA-DETRAC, and TrafficCAM, all evaluated on the BMD-45 validation split:    ## Comparison with Existing Datasets | Dataset | Venue | Task | View | Frames | Annotations | Classes | Cameras | Location | | ----------------- | --------------- | ----- | -------------- | ------- | ----------- | ------- | --------- | -------- | | IDD | WACV 2019 | D, S | Ego | 10K | 111.3K | 9 | — | IN | | UA-DETRAC | CVIU 2020 | D, M | Fixed | 140K | 1.21M | 4 | 24 | CN | | TrafficCAM | T-ITS 2025 | S | Fixed CCTV | 4.3K | 84.2K | 9 | NA | IN | | **BMD-45 (Ours)** | **CVPR-F 2026** | **D** | **Fixed CCTV** | **45K** | **481.9K** | **14** | **3,679** | **IN** | *D = Detection, S = Segmentation, M = Tracking; IN = India, CN = China* ## Collection & Processing Details - **Source:** ≈ 3,679 *Safe City* surveillance cameras operated by Bengaluru Police - **Coverage:** both junction and mid-block perspectives across multiple city zones - **Time period:** February 2025, daytime hours (06:00–18:00 IST) - **Resolution:** 1920 × 1080 RGB frames - **Selection:** images with high vehicle density, occlusion, and diverse viewpoints prioritized - **Filename obfuscation:** Image filenames are anonymized numeric IDs to prevent location inference ## Intended Uses - Training and benchmarking **vehicle detection models** for CCTV / fixed-camera deployment - Research in **Intelligent Transportation Systems (ITS)** for Indian and developing-world cities - Cross-dataset generalization studies for region-specific detection - Studying detection under **occlusion, heterogeneous traffic, and diverse viewpoints** ## License - **Dataset:** [CC BY 4.0 International](https://creativecommons.org/licenses/by/4.0/) - **Pre-trained Models:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0) ## Acknowledgements We thank the **Bengaluru Traffic Police (BTP)** and the **Bengaluru Police** for providing access to the *Safe City* camera data from which the image datasets used for this release were derived. We thank **Capital One** for sponsoring the prizes for the **Urban Vision Hackathon** competition. We thank **IISc's AI and Robotics Technology Park (ARTPARK)** and the **Centre for Infrastructure, Sustainable Transportation and Urban Planning (CiSTUP)** for funding the annotation and model-training efforts, and the **Kotak IISc AI-ML Centre (KIAC)** for providing the GPU resources required to train the models. We acknowledge the outreach support provided by the **ACM India Council** and the **IEEE India Council** to encourage chapter volunteers to participate in the hackathon. Lastly, we thank the **AI Centers of Excellence (AI COE)** initiative of the **Ministry of Education**, their **Apex Committee members**, and the **AIRAWAT Research Foundation**, whose support helped catalyze these efforts. Created by the **AI for Integrated Mobility (AIM)** group at the **Indian Institute of Science (IISc)**, Bengaluru.
pretty_name: BMD-45(班加罗尔交通移动数据集) license: cc-by-4.0 tags: - 计算机视觉 - 目标检测 - 交通 - 车辆 - 印度 - 闭路电视(CCTV) - 班加罗尔 - 城市交通 - 智能交通系统(Intelligent Transportation Systems) task_categories: - 目标检测 task_ids: - 车辆检测 language: - und annotations_creators: - 众包 source_datasets: [] size_categories: - 10000 < n < 100000 dataset_info: features: - name: 图像 dtype: 图像 - name: 目标对象 sequence: - name: 边界框 sequence: float32 - name: 类别 dtype: 类别标签: 名称列表: - 两厢轿车(Hatchback) - 三厢轿车(Sedan) - 运动型多用途汽车(SUV) - 多用途汽车(MUV) - 巴士(Bus) - 卡车(Truck) - 三轮车(Three-wheeler) - 两轮车(Two-wheeler) - 轻型商用车(LCV) - 小型巴士(Mini-bus) - 旅行面包车(Tempo-traveller) - 自行车(Bicycle) - 厢式货车(Van) - 其他(Other) splits: - name: 训练集 num_examples: 35792 - name: 验证集 num_examples: 10194 configs: - config_name: 默认配置 data_files: - split: 训练集 path: "BMD-45-Train/**" - split: 验证集 path: "BMD-45-Val/**" --- # BMD-45:班加罗尔交通移动数据集 **面向印度城市交通的大规模闭路电视(CCTV)车辆检测基准数据集** --- ## 数据集概述 **BMD-45**是一款面向印度的大规模车辆检测数据集,采集自全球交通最为拥堵的特大城市之一——班加罗尔的3679台运行中的闭路电视(CCTV)摄像头。 | 统计指标 | 数值 | | ----------------- | ----------------------------------- | | 总图像数 | **45986张(1920×1080 RGB格式)** | | 总标注数 | **约481947个边界框** | | 车辆类别数 | **14个细粒度类别** | | 摄像头来源 | **3679台“平安城市”闭路电视(CCTV)摄像头** | | 训练集划分 | 35792张图像 / 375003个标注 | | 验证集划分 | 10194张图像 / 106944个标注 | | 测试集划分 | 5110张图像(标注未公开) | | 图像分辨率 | 1920×1080像素 | | 标注格式 | COCO JSON格式 | BMD-45填补了现有交通数据集的关键空白:**大规模样本规模**、**多样化摄像头视角**以及**细粒度印度车辆分类体系**——此前的固定摄像头基准数据集(如UA-DETRAC、TrafficCAM、IDD)均不具备这些特性。 该数据集涵盖了印度城市环境中典型的密集、异构且无规则的交通场景,通过**空间与时间多样性准则**以及**难度评分机制**从长时间的闭路电视录像中采样图像,优先选取具有挑战性且信息丰富的帧。 ## 引用说明 有关数据集与模型的更多技术细节详见技术报告。 若您使用本数据集或模型,请引用以下文献: bibtex @inproceedings{bmd45_2026, title = {BMD-45: Bengaluru Mobility Dataset for Large-Scale Vehicle Detection from Urban CCTV}, author = {Akash Sharma and Chinmay Mhatre and Sankalp Gawali and Ruthvik Bokkasam and Brij Kishore and Vishwajeet Pattanaik and Tarun Rambha and Abdul R. Pinjari and Vijay Kovvali and Anirban Chakraborty and Punit Rathore and Raghu Krishnapuram and Yogesh Simmhan}, booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Findings (CVPRF26)}, year = {2026} } ## 数据集结构 本数据集采用如下文件夹组织形式: ### 1. BMD-45-Train/ 包含用于训练的**35792张图像**(约占数据集总量的78%)。 - `images_000/` 至 `images_007/`:为便于管理,训练图像被划分为多个子文件夹。 - `images_000/*`:训练图像(如`41.png`、`47.png`等),所有图像文件名在全数据集中均唯一。 - `images_001/*` 等其余子文件夹采用相同组织形式。 - `_annotations.coco.json`:训练图像的多数投票共识标注,采用**COCO JSON格式**。 - `metadata.jsonl`:面向HuggingFace ImageFolder的标注文件(每张图像对应一行JSON数据)。 ### 2. BMD-45-Val/ 包含用于验证的**10194张图像**(约占数据集总量的22%)。 - `images_000/` 至 `images_002/`:为便于管理,验证图像被划分为多个子文件夹。 - `images_000/*`:验证图像,所有文件名在训练集与验证集全集中均唯一。 - `images_001/*` 等其余子文件夹采用相同组织形式。 - `_annotations.coco.json`:验证图像的多数投票共识标注,采用**COCO JSON格式**。 - `metadata.jsonl`:面向HuggingFace ImageFolder的标注文件(每张图像对应一行JSON数据)。 ## 标注JSON格式规范 每个`_annotations.coco.json`文件均遵循标准COCO格式规范: - `images`:图像元数据列表,包含字段`id`、`file_name`、`width`、`height` - `annotations`:目标实例标注,包含字段`id`、`image_id`、`category_id`、`bbox [x, y, width, height]`、`area` - `categories`:分类体系(各ID与类别名如下) 每个`metadata.jsonl`文件为每张图像存储一行JSON数据,格式示例如下: json {"file_name": "images_000/41.png", "objects": {"bbox": [[x, y, w, h], ...], "categories": [0, 2, ...]}} ### 标注流程 - **数据来源**:2025年2月印度标准时间(IST)06:00至18:00期间采集的视频帧 - **预标注**:基于≈3000张专家标注图像微调的**RT-DETR v2-X**模型生成初始预测结果 - **众包标注**:超过550名学生志愿者通过带有排行榜的游戏化网页界面修正或验证预测结果 - **共识标注**:采用**多数投票**机制生成最终标注结果 ## 数据集加载方法 python from datasets import load_dataset # 从HuggingFace Hub加载数据集 ds = load_dataset("iisc-aim/BMD-45") # 访问样本 sample = ds["train"][0] image = sample["image"] objects = sample["objects"] # 格式为 {"bbox": [...], "categories": [...]} ## 车辆类别 | 类别ID | 类别名称 | 类别说明 | | ------ | ---------------- | --------------------------------------------------------------------------------------------------------------------------------------------------- | | 0 | 两厢轿车(Hatchback) | 无突出后备厢的小型乘用车。 | | 1 | 三厢轿车(Sedan) | 车身低矮、带有独立突出后备厢的乘用车。 | | 2 | 运动型多用途汽车(SUV) | 底盘高度较高、车身坚固且无突出后备厢的乘用车型车辆。 | | 3 | 多用途汽车(MUV) | 具备三排座椅、兼顾载客与载货功能的大型车辆。 | | 4 | 巴士(Bus) | 用于公共或私人客运的大型载客车辆,包括通勤班车与城际巴士。 | | 5 | 卡车(Truck) | 带有前置驾驶室与后置货厢的重型货运车辆。 | | 6 | 三轮车(Three-wheeler) | 前置单轮、后置双轮的紧凑型载客车辆,带有封闭乘客舱。 | | 7 | 两轮车(Two-wheeler) | 供1至2人驾乘的摩托车与踏板车,边界框包含车辆与驾乘人员。 | | 8 | 轻型商用车(LCV) | 用于中短途货运的轻量化货运车辆。 | | 9 | 小型巴士(Mini-bus) | 尺寸较短、座位数较少的紧凑型巴士,尺寸大于旅行面包车,通常采用平直前脸设计。 | | 10 | 旅行面包车(Tempo-traveller) | 带有高车顶与侧窗的中型载客面包车,尺寸介于厢式货车与小型巴士之间,前脸突出。 | | 11 | 自行车(Bicycle) | 非机动人力脚踏车辆,包括变速、非变速、女式与儿童自行车,边界框包含车辆与驾乘人员。 | | 12 | 厢式货车(Van) | 用于载客或载货的中型车辆,通常采用平直前脸与滑动侧门,尺寸小于旅行面包车。 | | 13 | 其他(Other) | 未归入上述类别的车辆,包括农用、专用或非常规设计的车辆。 | ## 基线结果 为验证BMD-45的必要性,研究团队将在**现有数据集上训练**的前沿目标检测器,在3000张班加罗尔闭路电视图像的专家标注参考集上进行评估。结果显示,所有在其他数据集上训练的模型均未达到实用精度: | 模型名称 | 训练数据集 | mAP@50:95 | | ---------------- | ---------- | --------- | | D-FINE X | IDD | 0.46 | | RT-DETRv2 X | TrafficCAM | 0.39 | | Grounding DINO | 零样本(Zero-shot) | 0.13 | > 以上均为**跨数据集基线结果**(模型在其他数据集上训练,而非BMD-45)。基于BMD-45训练的模型结果详见论文。 下图展示了在BMD-45上训练并在BMD-45验证集上评估的部分模型的每类别AP@50:95分布:  在BMD-45上训练的模型还通过**分类体系感知的类别映射协议**,展现出对**UA-DETRAC**、**IDD**与**TrafficCAM**的跨数据集泛化能力(完整结果详见论文)。 ## 跨数据集泛化能力 在BMD-45上训练的模型在以下数据集上进行了评估: - **UA-DETRAC**:高速公路固定摄像头数据集(中国,4个类别) - **IDD**:印度驾驶数据集(第一人称视角,9个类别) - **TrafficCAM**:印度闭路电视数据集(9个类别,4400帧) 为保证公平比较,研究团队采用类别映射协议,将BMD-45的14个细粒度类别合并为各目标数据集的粗粒度类别。 以下图表对比了在BMD-45上训练的模型与在IDD、UA-DETRAC、TrafficCAM上训练的模型的每类别AP@50:95分布,所有模型均在BMD-45验证集上评估:    ## 与现有数据集的对比 | 数据集名称 | 发表会议/期刊 | 任务类型 | 拍摄视角 | 图像数量 | 标注总数 | 类别数 | 摄像头数量 | 采集地点 | | ----------------- | --------------- | ----- | -------------- | ------- | ----------- | ------- | --------- | -------- | | IDD | WACV 2019 | D, S | 第一人称视角 | 10K | 111.3K | 9 | — | IN | | UA-DETRAC | CVIU 2020 | D, M | 固定摄像头 | 140K | 1.21M | 4 | 24 | CN | | TrafficCAM | T-ITS 2025 | S | 固定闭路电视 | 4.3K | 84.2K | 9 | NA | IN | | **BMD-45(本文提出)** | **CVPR-F 2026** | **目标检测** | **固定闭路电视** | **45K** | **481.9K** | **14** | **3,679** | **IN** | *注:D=目标检测(Detection),S=语义分割(Segmentation),M=目标跟踪(Tracking);IN=印度,CN=中国,NA=未提供* ## 数据采集与处理细节 - **数据来源**:班加罗尔警方运营的约3679台“平安城市”监控摄像头 - **采集范围**:覆盖城市多个区域的路口与路段中间视角 - **采集时段**:2025年2月,日间时段(印度标准时间06:00–18:00) - **图像分辨率**:1920×1080 RGB格式 - **图像筛选**:优先选取车辆密度高、存在遮挡且视角多样的图像 - **文件名混淆**:图像文件采用匿名数字ID命名,以避免推断拍摄位置 ## 预期应用场景 - 用于训练与基准测试**面向闭路电视/固定摄像头部署的车辆检测模型** - 面向印度及发展中国家城市的**智能交通系统(Intelligent Transportation Systems, ITS)** 研究 - 面向区域化目标检测的跨数据集泛化研究 - 针对**遮挡、异构交通与多样化视角**下的目标检测研究 ## 授权协议 - **数据集**:采用[CC BY 4.0 国际版](https://creativecommons.org/licenses/by/4.0/)授权 - **预训练模型**:采用[Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)授权 ## 致谢 感谢**班加罗尔交通警察局(BTP)**与**班加罗尔警方**提供本数据集所用的“平安城市”监控摄像头数据授权。 感谢**Capital One**为**城市视觉黑客松(Urban Vision Hackathon)**竞赛提供奖品赞助。 感谢**印度科学学院(IISc)人工智能与机器人技术园区(ARTPARK)**与**基础设施、可持续交通与城市规划中心(CiSTUP)**为标注与模型训练提供经费支持,以及**科塔克印度科学学院AI-ML中心(KIAC)**提供模型训练所需的GPU资源。 感谢**ACM印度分会**与**IEEE印度分会**提供外联支持,以鼓励各分会志愿者参与黑客松竞赛。 最后,感谢**教育部人工智能卓越中心(AI COE)**及其**高层委员会成员**与**AIRAWAT研究基金会**的支持,助力本项目推进。 本数据集由**印度科学学院(IISc)班加罗尔分校**的**综合移动AI(AIM)**团队研发。




