Self-Organization in Decentralized Networks: A Trial and Error Learning Approach
- 5 December 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 13 (1), 268-279
- https://doi.org/10.1109/twc.2013.112613.130405
Abstract
In this paper, the problem of channel selection and power control is jointly analyzed in the context of multiple-channel clustered ad-hoc networks, i.e., decentralized networks in which radio devices are arranged into groups (clusters) and each cluster is managed by a central controller (CC). This problem is modeled by game in normal form in which the corresponding utility functions are designed for making some of the Nash equilibria (NE) to coincide with the solutions to a global network optimization problem. In order to ensure that the network operates in the equilibria that are globally optimal, a learning algorithm based on the paradigm of trial and error learning is proposed. These results are presented in the most general form and therefore, they can also be seen as a framework for designing both games and learning algorithms with which decentralized networks can operate at global optimal points using only their available local knowledge. The pertinence of the game design and the learning algorithm are highlighted using specific scenarios in decentralized clustered ad hoc networks. Numerical results confirm the relevance of using appropriate utility functions and trial and error learning for enhancing the performance of decentralized networks.Keywords
This publication has 27 references indexed in Scilit:
- Self-Organization in Small Cell Networks: A Reinforcement Learning ApproachIEEE Transactions on Wireless Communications, 2013
- The Nash equilibrium region of the linear deterministic interference channel with feedbackPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Distributed power allocation with SINR constraints using trial and error learningPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Shannon Meets Nash on the Interference ChannelIEEE Transactions on Information Theory, 2011
- Design of Cognitive Radio Systems Under Temperature-Interference Constraints: A Variational Inequality ApproachIEEE Transactions on Signal Processing, 2010
- Autonomous dynamic spectrum management for coexistence of multiple cognitive tactical radio networksPublished by European Alliance for Innovation n.o. ,2010
- Learning by trial and errorGames and Economic Behavior, 2009
- Strategic Learning and its LimitsPublished by Oxford University Press (OUP) ,2004
- On the cluster based dynamic channel assignment for multihop ad hoc networksJournal of Communications and Networks, 2002
- Equilibrium points in n -person gamesProceedings of the National Academy of Sciences of the United States of America, 1950