Zhong, J, Zhang, L orcid.org/0000-0002-4535-3200, Gautam, P et al. (2 more authors) (2023) An Improved Q-Learning Based Handover Scheme in Cellular-Connected UAV Network. In: Proceedings of the 2022 25th International Symposium on Wireless Personal Multimedia Communications (WPMC). WPMC 2022 - The 25th International Symposium on Wireless Personal Multimedia Communications, 30 Oct - 02 Nov 2022, Herning, Denmark. IEEE , pp. 520-525. ISBN 978-1-6654-7319-4
Abstract
Cellular-Connected Unmanned Aerial Vehicles (UAVs) have been used for a variety of applications, from remote sensing, monitoring to the search and rescue operations. Many applications of UAVs rely on the seamless and reliable communication link to control the UAVs remotely and transmit the data. Thus, the challenges due to the mobility in three dimensional space, such as the air-to-ground channels, interference and handover (HO) problems must be addressed. The HO failure and unnecessary HO seriously affect the quality of service. Q-learning is an effective method to address the challenges in HO and has attracted a lot of attention. In this work, we introduce some changes in an existing HO algorithm and proposed an improved Q-Learning based HO algorithm. The formation of the Action Space considers both the Signal-to-Interference-plus-noise ratio (SINR) and the distance between Base station (BS) and UAV with different weights. The results show the proposed algorithm can further reduce the HO rate by increasing the weight of distance with slightly compromising the throughput and the outage rate. An optimal distance weight is suggested based on the analysis of the three performance indicators.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2022, IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
Keywords: | Wireless communication , Q-learning , Simulation , Interference , Handover , Autonomous aerial vehicles , Throughput |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Engineering & Physical Sciences (Leeds) > School of Electronic & Electrical Engineering (Leeds) > Institute of Communication & Power Networks (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 27 Sep 2022 12:21 |
Last Modified: | 01 Mar 2023 13:03 |
Status: | Published |
Publisher: | IEEE |
Identification Number: | 10.1109/WPMC55625.2022.10014798 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:191390 |