Stochastic Game-Theoretic Spectrum Access in Distributed and Dynamic Environment
- 31 October 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 64 (10), 4807-4820
- https://doi.org/10.1109/tvt.2014.2366559
Abstract
In this paper, we investigate the problem of channel selection for interference mitigation in opportunistic spectrum access networks using a stochastic game-theoretic approach. The studied network is distributed and dynamic , where each user only has its individual information, and no information exchange is available among users. Moreover, each user is considered to be dynamically active due to its specific data service requirement. Specifically, a user randomly becomes active and then competes for the wireless channel to transmit for a random duration. To capture such dynamic interactions among users, a dynamic interference graph is defined, and based on this, the interference mitigation problem is formulated as a graphical stochastic game. It is proved to be an exact potential game, in which the existence of the Nash equilibrium (NE) is guaranteed. Then, the performance bounds of the NE are theoretically analyzed. Furthermore, we design a fully distributed and online algorithm based on stochastic learning for the interference-mitigation channel selection, which is proved to converge to the NE of the formulated game. Finally, we conduct simulations to validate the effectiveness of the proposed algorithm for interference mitigation and throughput improvement in the distributed and dynamic environment.Funding Information
- Project of Natural Science Foundation of China (61301163, 61301162)
- Jiangsu Provincial Natural Science Foundation of China (BK20130067)
- Natural Science and Engineering Research Council (NSERC), Canada
This publication has 47 references indexed in Scilit:
- A Joint Game-Theoretic Interference Coordination Approach in Uplink Multi-Cell OFDMA NetworksWireless Personal Communications, 2014
- Optimal power allocation and user scheduling in multicell networks: Base station cooperation using a game-theoretic approachIEEE Transactions on Wireless Communications, 2014
- Self-Organization in Decentralized Networks: A Trial and Error Learning ApproachIEEE Transactions on Wireless Communications, 2013
- Opportunistic Spectrum Access Using Partially Overlapping Channels: Graphical Game and Uncoupled LearningIEEE Transactions on Communications, 2013
- Subcarrier allocation based on correlated equilibrium in multi-cell OFDMA systemsEURASIP Journal on Wireless Communications and Networking, 2012
- Opportunistic Bandwidth Sharing Through Reinforcement LearningIEEE Transactions on Vehicular Technology, 2010
- Distributed Q-Learning for Aggregated Interference Control in Cognitive Radio NetworksIEEE Transactions on Vehicular Technology, 2010
- Load Balancing Routing with Bounded StretchEURASIP Journal on Wireless Communications and Networking, 2009
- Joint Strategy Fictitious Play With Inertia for Potential GamesIEEE Transactions on Automatic Control, 2009
- If multi-agent learning is the answer, what is the question?Artificial Intelligence, 2007