A New Energy Prediction Algorithm for Energy-Harvesting Wireless Sensor Networks With Q-Learning
Open Access
- 7 September 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 4, 5755-5763
- https://doi.org/10.1109/access.2016.2606541
Abstract
Traditional wireless sensor networks (WSNs) face the problem of a limited-energy source, typically batteries, resulting in the need for careful and effective utilization of the energy source. However, inevitable energy depletion will eventually disturb the operation of a WSN. Energy harvesting (EH) technology is acquiring particular interest, because it has the potential to provide a continuous energy supply in battery-powered WSNs. Solar energy is the most effective environmental energy for EH-WSNs because of its high energy intensity, which comes from a non-controllable source. Therefore, the prediction of future energy availability is a critical issue, as the amount of the harvestable energy may vary over time. In this paper, a novel solar energy prediction algorithm with Q-learning, called Q-learning-based solar energy prediction (QL-SEP), is proposed. Q-learning is an effective way of predicting future actions based on past observations. The distinctive feature of QL-SEP is that not only past days' observations but also the current weather conditions are considered for prediction. The performance of QL-SEP is simulated in this paper using real-world measurements obtained from a solar panel in comparison with the state-of-art approaches.This publication has 17 references indexed in Scilit:
- ERI-MAC: An Energy-Harvested Receiver-Initiated MAC Protocol for Wireless Sensor NetworksInternational Journal of Distributed Sensor Networks, 2014
- Implications of diurnal and seasonal variations in renewable energy generation for large scale energy storageJournal of Renewable and Sustainable Energy, 2014
- Power management in SMAC-based energy-harvesting wireless sensor networks using queuing analysisJournal of Network and Computer Applications, 2013
- Probabilistic polling for multi-hop energy harvesting wireless sensor networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Dynamic Duty-Cycle Scheduling Schemes for Energy-Harvesting Wireless Sensor NetworksIEEE Communications Letters, 2011
- ODMACPublished by Association for Computing Machinery (ACM) ,2011
- Balanced energy allocation scheme for a solar-powered sensor system and its effects on network-wide performanceJournal of Computer and System Sciences, 2011
- QoS-aware MAC protocols for wireless sensor networks: A surveyComputer Networks, 2011
- Power management in energy harvesting sensor networksACM Transactions on Embedded Computing Systems, 2007
- MAC protocols for wireless sensor networks: a surveyIEEE Communications Magazine, 2006