Learning equilibria with partial information in decentralized wireless networks
- 12 August 2011
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Magazine
- Vol. 49 (8), 136-142
- https://doi.org/10.1109/mcom.2011.5978427
Abstract
In this article, a survey of several important equilibrium concepts for decentralized networks is presented. The term decentralized is used here to refer to scenarios where decisions (e.g., choosing a power allocation policy) are taken autonomously by devices interacting with each other (e.g., through mutual interference). The iterative long-term interaction is characterized by stable points of the wireless network called equilibria. The interest in these equilibria stems from the relevance of network stability and the fact that they can be achieved by letting radio devices to repeatedly interact over time. To achieve these equilibria, several learning techniques - the best response dynamics, fictitious play, smoothed fictitious play, reinforcement learning algorithms, and regret matching - are discussed in terms of information requirements and convergence properties. Most of the notions introduced here, for both equilibria and learning schemes, are illustrated by a simple case study, an interference channel with two transmitter-receiver pairs.Keywords
This publication has 8 references indexed in Scilit:
- On the Nash Equilibria in Decentralized Parallel Interference ChannelsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2011
- How can ignorant but patient cognitive terminals learn their strategy and utility?Published by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- Methodologies for analyzing equilibria in wireless gamesIEEE Signal Processing Magazine, 2009
- Game theory and the flat-fading gaussian interference channelIEEE Signal Processing Magazine, 2009
- Game theory and the frequency selective interference channelIEEE Signal Processing Magazine, 2009
- Optimal Linear Precoding Strategies for Wideband Non-Cooperative Systems Based on Game Theory—Part II: AlgorithmsIEEE Transactions on Signal Processing, 2008
- Strategic Learning and its LimitsPublished by Oxford University Press (OUP) ,2004
- Decentralized learning of Nash equilibria in multi-person stochastic games with incomplete informationIEEE Transactions on Systems, Man, and Cybernetics, 1994