Urban Sensing for Multi-Destination Workers via Deep Reinforcement Learning

Urban sensing aims to sense the status of the city, e.g., air quality, noise level, concentration of viruses, which can be completed by spatial crowdsourcing. Multi-destination people, who have many intermediate locations to visit before the final destination, e.g., couriers and tourists, are ideal recruitment candidates to conduct sensing tasks since they spend more time outside and have a wide spatio-temporal distribution. However, existing spatial crowdsourcing methods are only designed for workers who have single destinations, e.g., commuters, which are not applicable to recruit the multiple-destination people. Therefore, in this paper, we generalize the urban crowdsensing problem to the multi-destination scenario, namely, Urban Sensing for Multi-Destination Workers (USMDW). We prove its NP-hardness, and propose a framework Urban Sensing for Multi-destination Workers via Deep REinforcement learning, i.e., SMORE, to solve it effectively and efficiently. SMORE is composed of two steps: 1) candidate assignment initialization, which initializes all feasible sensing task-worker assignment pairs by a pre-trained reinforcement learning-based working route planning solver; and 2) reinforcement learning-based iterative selection, which iteratively selects a sensing task-worker pair to the current assignment via a novel policy network, i.e., Two-stage Assignment Selection Network (TASNet). Extensive experiments on three real-world datasets show SMORE outperforms the best baseline in data coverage by 5.2% on average with high efficiency.