EasyCom

Easy Communications (EasyCom) 数据集是世界首创的数据集，旨在帮助减轻由增强现实 (AR) 驱动的多传感器以自我为中心的世界观带来的鸡尾酒会效应。该数据集包含 AR 眼镜以自我为中心的多通道麦克风阵列音频、宽视场 RGB 视频、语音源姿势、耳机麦克风音频、带注释的语音活动、语音转录、头部和面部边界框以及源识别标签。我们已经创建并正在发布此数据集，以促进针对鸡尾酒会问题的多模式 AR 解决方案的研究。The Easy Communications (EasyCom) dataset is the world's first-of-its-kind dataset designed to mitigate the cocktail party effect induced by augmented reality (AR)-driven multi-sensor egocentric worldviews. This dataset contains egocentric multi-channel microphone array audio captured by AR glasses, wide-field-of-view RGB video, speech source poses, headset microphone audio, annotated speech activity, speech transcripts, head and facial bounding boxes, and source identification labels. We have created and are releasing this dataset to facilitate research on multimodal AR solutions for the cocktail party problem.

搜集汇总

背景与挑战

背景概述

EasyCom是一个世界首创的数据集，专注于减轻增强现实环境中的鸡尾酒会效应，提供多通道麦克风音频、RGB视频、语音姿势和标注等数据。它旨在支持多模态AR解决方案的研究，以改善嘈杂环境下的通信问题。