Skip to main navigation Skip to search Skip to main content

AoI-and-Energy-Efficient Multi-UAV Coordination via Hierarchical Deep Reinforcement Learning

  • Yunjie JIA
  • , Yong SONG*
  • , Jiong JIN
  • , Jiyu CHENG
  • , Heteng ZHANG
  • , Rui SONG
  • , Wei ZHANG
  • , Jun ZHANG
  • , Sam KWONG*
  • *Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

Uncrewed aerial vehicles (UAVs) are increasingly used in Internet of Things (IoT) applications that require timely information acquisition, such as environmental surveillance, wildfire detection, and emergency response. Although multi-UAV systems provide improved coverage and flexibility, efficiently coordinating multiple UAVs to maintain information freshness, measured by the age of information (AoI), while reducing energy consumption remains challenging, especially in large-scale deployments. To address this problem, we propose GALA, a hierarchical deep reinforcement learning (DRL) framework for AoI- and energy-efficient multi-UAV coordination. GALA follows a coarse-to-fine paradigm with a high-level global allocator (GA) for UAV–device assignment and a low-level local navigator (LA) for allocation-conditioned trajectory execution. The GA uses adaptive feature aggregation over a graph-based representation to improve coordination efficiency and scalability, while the LA adopts an AoI-aware decision strategy for effective local control. A two-stage DRL training scheme further improves learning efficiency. Extensive comparisons with state-of-the-art baselines and ablation studies demonstrate the superiority of GALA across diverse settings. Real-world experiments further validate their practical applicability.

Original languageEnglish
Number of pages14
JournalIEEE Transactions on Systems, Man, and Cybernetics: Systems
Early online date14 Jul 2026
DOIs
Publication statusE-pub ahead of print - 14 Jul 2026

Bibliographical note

Publisher Copyright:
© 2013 IEEE.

Funding

This work was supported in part by Shandong Provincial Natural Science Foundation under GrantZR2025ZD12, in part by the National Natural Science Foundation of China under Grant 62573260, in part by Shenzhen Fundamental Research Program under Grant JCYJ20250604124223030, in part by the Lingnan University Direct under Grant F106112 and Grant F101101, and in part by the National Research Foundation of Korea under Grant RS-2025-00555463 and Grant RS-2025-25456394.

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 7 - Affordable and Clean Energy
    SDG 7 Affordable and Clean Energy

Keywords

  • Deep reinforcement learning (DRL)
  • information freshness
  • multirobot systems
  • trajectory planning

Fingerprint

Dive into the research topics of 'AoI-and-Energy-Efficient Multi-UAV Coordination via Hierarchical Deep Reinforcement Learning'. Together they form a unique fingerprint.

Cite this