Morozs, Nils orcid.org/0000-0001-9862-7378, Clarke, Tim orcid.org/0000-0002-5238-4769 and Grace, David orcid.org/0000-0003-4493-7498 (2016) Cognitive Spectrum Management in Dynamic Cellular Environments::A Case-Based Q-Learning Approach. Engineering Applications of Artificial Intelligence. pp. 239-249. ISSN 0952-1976
Abstract
This paper examines how novel cellular system architectures and intelligent spectrum management techniques can be used to play a key role in accommodating the exponentially increasing demand for mobile data capacity in the near future. A significant challenge faced by the artificial intelligence methods applied to such flexible wireless communication systems is their dynamic nature, e.g. network topologies that change over time. This paper proposes an intelligent case-based Q-learning method for dynamic spectrum access (DSA) which improves and stabilises the performance of cognitive cellular systems with dynamic topologies. The proposed approach is the combination of classical distributed Q-learning and a novel implementation of case-based reasoning which aims to facilitate a number of learning processes running in parallel. Large scale simulations of a stadium small cell network show that the proposed case-based Q-learning approach achieves a consistent improvement in the system quality of service (QoS) under dynamic and asymmetric network topology and traffic load conditions. Simulations of a secondary spectrum sharing scenario show that the cognitive cellular system that employs the proposed case-based Q-learning DSA scheme is able to accommodate a 28-fold increase in the total primary and secondary system throughput, but with no need for additional spectrum and with no degradation in the primary user QoS.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2016 Elsevier Ltd. All rights reserved.This is an author-produced version of the published paper. Uploaded in accordance with the publisher’s self-archiving policy. |
Keywords: | Reinforcement Learning,CELLULAR NETWORKS,case-based reasoning,dynamic spectrum access |
Dates: |
|
Institution: | The University of York |
Academic Units: | The University of York > Faculty of Sciences (York) > Electronic Engineering (York) |
Depositing User: | Pure (York) |
Date Deposited: | 28 Jul 2016 23:03 |
Last Modified: | 05 Jan 2025 00:12 |
Published Version: | https://doi.org/10.1016/j.engappai.2016.07.002 |
Status: | Published |
Refereed: | Yes |
Identification Number: | 10.1016/j.engappai.2016.07.002 |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:103106 |