Text2Loc: 3D Point Cloud Localization from Natural Language

Hi, I am standing on the west of a green building, east of a green road, west of a black garage... Got it! Coming soon! Localization Recall (%) Number of top retrievals Figure 1. (Left) We introduce Text2Loc, a solution designed for city-scale position localization using textual descriptions. When provided with a point cloud representing the surroundings and a textual query describing a position, Text2Loc determines the most probable location of that described position within the map. (Right) Localization performance on the KITTI360Pose test set. The proposed Text2Loc achieves consistently better performance across all top retrieval numbers. Notably, it outperforms the best baseline by up to 2 times, localizing text queries below 5 m.