Short vs. Long-term Coordination of Drones: When Distributed Optimization Meets Deep Reinforcement Learning

Swarms of smart drones, with the support of charging technology, can provide completing sensing capabilities in Smart Cities, such as traffic monitoring and disaster response. Existing approaches, including distributed optimization and deep reinforcement learning (DRL), aim to coordinate drones to achieve cost-effective, high-quality navigation, sensing, and recharging. However, they have distinct challenges: short-term optimization struggles to provide sustained benefits, while long-term DRL lacks scalability, resilience, and flexibility. To bridge this gap, this paper introduces a new progressive approach that encompasses the planning and selection based on distributed optimization, as well as DRL-based flying direction scheduling. Extensive experiment with datasets generated from realisitic urban mobility demonstrate the outstanding performance of the proposed solution in traffic monitoring compared to three baseline methods.

Coordination of Drones at Scale: Decentralized Energy-aware Swarm Intelligence for Spatio-temporal Sensing

Smart City applications, such as traffic monitoring and disaster response, often use swarms of intelligent and cooperative drones to efficiently collect sensor data over different areas of interest and time spans. However, when the required sensing becomes spatio-temporally large and varying, a collective arrangement of sensing tasks to a large number of battery-restricted and distributed drones is challenging. To address this problem, we introduce a scalable and energy-aware model for planning and coordination of spatio-temporal sensing. The coordination model is built upon a decentralized multi-agent collective learning algorithm (EPOS) to ensure scalability, resilience, and flexibility that existing approaches lack of. Experimental results illustrate the outstanding performance of the proposed method compared to state-of-the-art methods. Analytical results contribute a deeper understanding of how coordinated mobility of drones influences sensing performance. This novel coordination solution is applied to traffic monitoring using real-world data to demonstrate a $46.45\%$ more accurate and $2.88\%$ more efficient detection of vehicles as the number of drones become a scarce resource.

3, 2, 1, Drones Go! A Testbed to Take off UAV Swarm Intelligence for Distributed Sensing

This paper introduces a testbed to study distributed sensing problems of Unmanned Aerial Vehicles (UAVs) exhibiting swarm intelligence. Several Smart City applications, such as transport and disaster response, require efficient collection of sensor data by a swarm of intelligent and cooperative UAVs. This often proves to be too complex and costly to study systematically and rigorously without compromising scale, realism and external validity. With the proposed testbed, this paper sets a stepping stone to emulate, within small laboratory spaces, large sensing areas of interest originated from empirical data and simulation models. Over this sensing map, a swarm of low-cost drones can fly allowing the study of a large spectrum of problems such as energy consumption, charging control, navigation and collision avoidance. The applicability of a decentralized multi-agent collective learning algorithm (EPOS) for UAV swarm intelligence along with the assessment of power consumption measurements provide a proof-of-concept and validate the accuracy of the proposed testbed.