Abstract:In this paper, we investigate a six dimensional movable antenna (6DMA) enable integrated sensing and communications (ISAC) network in low-altitude economy. The studied 6DMA can move in a three-dimensional space and rotate around its surface center, making full use of spatial freedom to adapt to the different location distributions of uncrewed aerial vehicles (UAVs) adjust channel conditions in time. However, since the rotation and location change of 6DMA requires the assistance of a physical device, it is unreasonable for 6DMA to change locations too frequently. Therefore, we propose a hierarchical deep reinforcement learning algorithm based on twin delayed deep deterministic policy gradient. The first layer optimizes the rotation and location of 6DMA with infrequent updates, and the second layer optimizes the UAV flight direction and base station transmit beamforming matrix in each time slot. Under the condition of satisfying the sensing intensity of the sensing target, the total data transmission rate to the UAVs is maximized. The numerical results show that the proposed 6DMA-enable ISAC algorithm through joint optimization of multiple variables performs significantly better than the partially movable scheme and the fixed antenna position scheme.



Abstract:Unmanned aerial vehicles (UAVs) assisted Internet of things (IoT) systems have become an important part of future wireless communications. To achieve higher communication rate, the joint design of UAV trajectory and resource allocation is crucial. This letter considers a scenario where a multi-antenna UAV is dispatched to simultaneously collect data from multiple ground IoT nodes (GNs) within a time interval. To improve the sum data collection (SDC) volume, i.e., the total data volume transmitted by the GNs, the UAV trajectory, the UAV receive beamforming, the scheduling of the GNs, and the transmit power of the GNs are jointly optimized. Since the problem is non-convex and the optimization variables are highly coupled, it is hard to solve using traditional optimization methods. To find a near-optimal solution, a double-loop structured optimization-driven deep reinforcement learning (DRL) algorithm and a fully DRL-based algorithm are proposed to solve the problem effectively. Simulation results verify that the proposed algorithms outperform two benchmarks with significant improvement in SDC volumes.