Distributed Q-learning based dynamic spectrum management in cognitive cellular systems: Choosing the right learning rate
- 1 June 2014
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE) in 2014 IEEE Symposium on Computers and Communications (ISCC)
Abstract
This paper presents the concept of the Win-or-Learn-Fast (WoLF) variable learning rate for distributed Q-learning based dynamic spectrum management algorithms. It demonstrates the importance of choosing the learning rate correctly by simulating a large scale stadium temporary event network. The results show that using the WoLF variable learning rate provides a significant improvement in quality of service, in terms of the probabilities of file blocking and interruption, over typical values of fixed learning rates. The results have also demonstrated that it is possible to provide a better and more robust quality of service using distributed Q-learning with a WoLF variable learning rate, than a spectrum sensing based opportunistic spectrum access scheme, but with no spectrum sensing involved.Keywords
This publication has 12 references indexed in Scilit:
- Transfer Learning: A Paradigm for Dynamic Spectrum and Topology Management in Flexible ArchitecturesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Performance of distributed multi-agent multi-state reinforcement spectrum management using different exploration schemesExpert Systems with Applications, 2013
- Heuristically-Accelerated Multiagent Reinforcement LearningIEEE Transactions on Cybernetics, 2013
- Application of cognition based resource allocation strategies on a multi-hop backhaul networkPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Spectrum-aware dynamic channel assignment in cognitive radio networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Self-Organized Resource Allocation for LTE Pico Cells: A Reinforcement Learning ApproachPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- MIMO Truncated Shannon Bound for system level capacity evaluation of wireless networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- A Q-learning based approach to interference avoidance in self-organized femtocell networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- Cognitive Cellular Systems within the TV SpectrumPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- On channel definitions and rules for continuous dynamic channel selection in coexistence etiquettes for radio systemsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002