ClimbingCap: Multi-Modal Dataset and Method for Rock Climbing in World Coordinate

Dataset: AscendMotion No Markers With Markers World Coordinate 3D Scene Method: ClimbingCap RGB LiDAR Points RGB IMU LiDAR Points Figure 1. Overview. To address the challenging problem of global climbing motion recovery, we collect the dataset AscendMotion, using LiDAR, RGB camera and Inertial Measurement Unit (IMU) motion capture system with accurate motion labels and global trajectories (the blue and orange human bodies in right side of the figure represent labeled motions, and the orange curve represents the motion trajectory in the world coordinate.). Meanwhile, we propose ClimbingCap, a global climbing motion capturing method in world coordinate. As shown in the left part of this figure, it uses both image and LiDAR point cloud to recover human motions.