Du, J., Kong, Z., Sun, A. et al. (4 more authors) (2023) MADDPG-based joint service placement and task offloading in MEC empowered air-ground integrated networks. IEEE Internet of Things Journal, 11 (6). pp. 10600-10615. ISSN 2327-4662
Abstract
Multi-access Edge Computing (MEC) empowered Air-Ground Integrated Networks (AGINs) hold great promise in delivering accessible computing services for users and Internet of Things (IoT) applications, such as forest fire monitoring, emergency rescue operations, etc. In this paper, we present a comprehensive air-ground integrated MEC framework, where edge servers carried by Unmanned Aerial Vehicles (UAVs) will provide efficient computation services to IoT devices and User Equipment (which are collectively referred to as UEs). We aim to minimize the long-term average weighted sum of task completion delay and economic expenditure for all the UEs. This objective is achieved through various strategies, including pre-installing new service instances into UAVs, removing idle service instances from UAVs, task offloading decision making, access control, selecting appropriate service instances for each offloaded service request, and resource allocation optimization. Considering the complexity of the problem and the dynamics of the system, we reformulate the problem as a Markov decision process (MDP) and present a Multi-Agent Deep Deterministic Policy Gradient (MADDPG)-based algorithm to enable low-complexity and real-time adaptive decision-making. Since our problem contains integer, binary and continuous variables, it is not straightforward to apply the MADDPG algorithm. Specifically, we first normalize the continuous variables, and then convert the continuous output generated by MADDPG into discrete variables, while ensuring the coupling constraints between different variables are preserved. The simulation results demonstrate the fast convergence of our proposed algorithm and its superior performance in minimizing costs compared with the baseline algorithms.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2023 The Authors. Except as otherwise noted, this author-accepted version of a journal article published in IEEE Internet of Things Journal is made available via the University of Sheffield Research Publications and Copyright Policy under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution and reproduction in any medium, provided the original work is properly cited. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ |
Keywords: | Air-Ground Integrated Networks; computation offloading; service deployment; resource allocation; deep reinforcement learning |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Electronic and Electrical Engineering (Sheffield) |
Funding Information: | Funder Grant number UK RESEARCH AND INNOVATION 101086219 EP/X038971/1 UK Research and Innovation EP/X038971/1 |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 26 Oct 2023 16:07 |
Last Modified: | 30 Oct 2024 04:16 |
Status: | Published |
Publisher: | Institute of Electrical and Electronics Engineers |
Refereed: | Yes |
Identification Number: | 10.1109/JIOT.2023.3326820 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:204470 |
Download
Filename: space_air_ground_mec_deploy_offloading_NOMA_final.pdf
Licence: CC-BY 4.0