Distributed Q-Learning for Aggregated Interference Control in Cognitive Radio Networks
Top Cited Papers
- 17 February 2010
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 59 (4), 1823-1834
- https://doi.org/10.1109/tvt.2010.2043124
Abstract
This paper deals with the problem of aggregated interference generated by multiple cognitive radios (CRs) at the receivers of primary (licensed) users. In particular, we consider a secondary CR system based on the IEEE 802.22 standard for wireless regional area networks (WRANs), and we model it as a multiagent system where the multiple agents are the different secondary base stations in charge of controlling the secondary cells. We propose a form of real-time multiagent reinforcement learning, which is known as decentralized Q-learning, to manage the aggregated interference generated by multiple WRAN systems. We consider both situations of complete and partial information about the environment. By directly interacting with the surrounding environment in a distributed fashion, the multiagent system is able to learn, in the first case, an efficient policy to solve the problem and, in the second case, a reasonably good suboptimal policy. Computational and memory requirement considerations are also presented, discussing two different options for uploading and processing the learning information. Simulation results, which are presented for both the upstream and downstream cases, reveal that the proposed approach is able to fulfill the primary-user interference constraints, without introducing signaling overhead in the system.This publication has 12 references indexed in Scilit:
- Accumulative Interference Modeling for Cognitive Radios with Distributed Channel AccessPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Analysis of Aggregated Interference at DTV Receivers in TV BandsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- IEEE 802.22: An Introduction to the First Wireless Standard based on Cognitive RadiosJournal of Communications, 2006
- Performance of power detector sensors of DTV signals in IEEE 802.22 WRANsPublished by Association for Computing Machinery (ACM) ,2006
- Cooperative Multi-Agent Learning: The State of the ArtAutonomous Agents and Multi-Agent Systems, 2005
- Cognitive radio: brain-empowered wireless communicationsIEEE Journal on Selected Areas in Communications, 2005
- Autonomous call admission control with prioritized handoff in cellular networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- A Q-learning-based dynamic channel assignment technique for mobile communication systemsIEEE Transactions on Vehicular Technology, 1999
- Learning policies for partially observable environments: Scaling upPublished by Elsevier BV ,1995
- Technical Note: Q-LearningMachine Learning, 1992