Smart-Toy and Smart-Bedsheet Dataset Based on Pressure Mapping Smart Textile

For details about the two datasets, please read ''introduction_to_the_two_datasets.pdf". Based on the pressure mapping smart textile, we have developed two applications: Smart-Toy and Smart-Bedsheet, as shown in Fig. 1 and Fig. 3. For the Smart-Toy, we were interested in common interactions with this plush toy in life (20 actions in total as shown in Fig. 2) and invited 10 participants (5 females and 5 males, aged 23∼35) to create the Smart-Toy dataset, the details of which are presented in section 2. For the SmartBedsheet, we used it to identify common sleeping postures (11 postures in total as shown in Fig. 4), and we invited 13 participants (4 females and 9 males, the weight ranges from 42kg to 110kg, and the height ranges from 155cm to 188cm) to create the Smart-Bedsheet dataset, the details of which will be introduced in section 3. Welcome to visit our website: http://pplab.ustc.edu.cn/. If you have any questions about the two datasets, please feel free to contact us ([e-mail]) Funding Our work is supported ”the National Natural Science Foundation of China” (Grant No.62072420) and ”the Fundamental Research Funds for the Central Universities” (Grant No.2150110020). 1. Smart-Toy dataset A Smart-Toy was created as a 3D application. The majority of the toy’s surface is covered with a 23 × 16 textile sensor matrix, with a spatial resolution of 1.5cm × 1.5cm, as shown in Fig. 1b. The pressure sensitive textile is sewn onto the inner side of the plush toy’s skin, flipped, and folded together with the skin into a cuboid. The pressure distribution is digitalized by on-chip 12-bits ADCs in the dsPIC33F and transmitted wirelessly via Bluetooth to a smart phone at 41 frames/second. Ten healthy adults (5 females and 5 males, aged 23∼35) were invited to create the play interaction dataset. They followed the instructions from the computer and carried out 20 play interactions (as shown in Fig. 2) in a random order (one session). Each participant finished 10 sessions. We manually label each instance by observing video recordings and pressure distribution changes. 2. Smart-Bedsheet dataset A Smart-Bedsheet is covered with a 56 × 40 textile sensor matrix on the surface, with a spatial resolution of 3.2cm × 2.3cm, as shown in Fig. 3. The pressure distribution is digitalized by on-chip 12-bits ADCs in the STM32F303ZET6 and transmitted via USB to a laptop at 55 frames/second. Thirteen healthy adults (4 females and 9 males, the weight ranges from 42kg to 110kg, and the height ranges from 155cm to 188cm) were invited. They followed the instructions from the organizer, completed 11 sleeping postures (as shown in Fig. 4) in a random order, and each posture lasted for about 5 seconds. Each participant finished 10 sessions. Although each posture lasted 5 seconds in each session, these frames are extremely similar, so we propose to take a random frame as the instance of this posture.关于这两个数据集的详细信息，请参阅《introduction_to_the_two_datasets.pdf》。本研究基于压力映射智能纺织面料，开发了两款应用装置：智能玩具（Smart-Toy）与智能床单（Smart-Bedsheet），分别如图1与图3所示。针对智能玩具装置，我们聚焦于日常生活中与该毛绒玩具的常见交互场景（共包含20类动作，如图2所示），招募了10名受试者（5男5女，年龄区间为23~35岁）参与构建智能玩具数据集，该数据集的详细内容将在第2节中介绍。针对智能床单装置，我们利用其识别常见睡眠姿势（共包含11类姿势，如图4所示），招募了13名受试者（4男9女，体重范围为42kg~110kg，身高范围为155cm~188cm）参与构建智能床单数据集，该数据集的详细内容将在第3节中介绍。欢迎访问我们的官方网站：http://pplab.ustc.edu.cn/。若您对这两个数据集有任何疑问，请随时联系我们（邮箱：[e-mail]）。基金支持：本研究得到国家自然科学基金（National Natural Science Foundation of China，项目编号：62072420）以及中央高校基本科研业务费专项资金（Fundamental Research Funds for the Central Universities，项目编号：2150110020）资助。1. 智能玩具（Smart-Toy）数据集：一款智能玩具被开发为3D应用装置。该玩具的大部分表面覆盖有23×16的纺织传感器矩阵，空间分辨率为1.5cm×1.5cm，如图1b所示。压力感应纺织面料被缝制于该毛绒玩具表皮内侧，随后翻转并与表皮一同折叠为长方体结构。压力分布数据由dsPIC33F芯片内置的12位模数转换器（Analog-to-Digital Converter, ADC）进行数字化处理，并通过蓝牙（Bluetooth）以41帧/秒的速率无线传输至智能手机。我们招募了10名健康成年人（5男5女，年龄区间为23~35岁）参与构建交互数据集。受试者按照计算机给出的指示，以随机顺序完成20类玩具交互动作（如图2所示），单次实验为一个会话。每名受试者完成10个会话。研究人员通过观察视频录制画面与压力分布变化，对每一个数据样本进行人工标注。2. 智能床单（Smart-Bedsheet）数据集：智能床单表面覆盖有56×40的纺织传感器矩阵，空间分辨率为3.2cm×2.3cm，如图3所示。压力分布数据由STM32F303ZET6芯片内置的12位模数转换器（ADC）进行数字化处理，并通过USB以55帧/秒的速率传输至笔记本电脑。我们招募了13名健康成年人（4男9女，体重范围为42kg~110kg，身高范围为155cm~188cm）参与实验。受试者按照组织者的指示，以随机顺序完成11类睡眠姿势（如图4所示），每类姿势持续约5秒。每名受试者完成10个会话。尽管单次会话中每类姿势持续5秒，但采集到的各帧数据极为相似，因此我们选取随机一帧作为该姿势的数据样本。