User Association for Load Balancing in Vehicular Networks: An Online Reinforcement Learning Approach
- 16 June 2017
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 18 (8), 2217-2228
- https://doi.org/10.1109/tits.2017.2709462
Abstract
Recently, a number of technologies have been developed to promote vehicular networks. When vehicles are associated with the heterogeneous base stations (e.g., macrocells, picocells, and femtocells), one of the most important problems is to make load balancing among these base stations. Different from common mobile networks, data traffic in vehicular networks can be observed having regularities in the spatial-temporal dimension due to the periodicity of urban traffic flow. By taking advantage of this feature, we propose an online reinforcement learning approach, called ORLA. It is a distributed user association algorithm for network load balancing in vehicular networks. Based on the historical association experiences, ORLA can obtain a good association solution through learning from the dynamic vehicular environment continually. In the long run, the real-time feedback and the regular traffic association patterns both help ORLA cope with the dynamics of network well. In experiments, we use QiangSheng taxi movement to evaluate the performance of ORLA. Our experiments verify that ORLA has higher quality load balancing compared with other popular association methods.Keywords
Funding Information
- National Natural Science Foundation of China (61602110)
- Sailing Program (16YF1400200)
- Shanghai Science and Technology Innovation Action Plan Project (16511100900)
- National Science Foundation for Postdoctoral Scientists of China (2016M591575)
- National Natural Science Foundation of China (61571331)
- Fok Ying-Tong Education Foundation for Young Teachers in the Higher Education Institutions of China (151066)
- Shuguang Program from Shanghai Education Development Foundation (14SG20)
- Fundamental Research Funds for the Central Universities (2232016D-30)
This publication has 23 references indexed in Scilit:
- Opportunistic WiFi Offloading in Vehicular Environment: A Game-Theory ApproachIEEE Transactions on Intelligent Transportation Systems, 2016
- Efficient Cellular Load Balancing Through Mobility-Enriched Vehicular CommunicationsIEEE Transactions on Intelligent Transportation Systems, 2016
- Energy-Efficiency Oriented Traffic Offloading in Wireless Networks: A Brief Survey and a Learning Approach for Heterogeneous Cellular NetworksIEEE Journal on Selected Areas in Communications, 2015
- E 3Published by Association for Computing Machinery (ACM) ,2013
- S3: Characterizing Sociality for User-Friendly Steady Load Balancing in Enterprise WLANsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2013
- Dynamic cell association for downlink sum rate maximization in multi-cell heterogeneous networksPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2012
- Distributed $\alpha$-Optimal User Association and Cell Load Balancing in Wireless NetworksIEEE/ACM Transactions on Networking, 2011
- Cell Breathing Techniques for Load Balancing in Wireless LANsIEEE Transactions on Mobile Computing, 2009
- An MDP-Based Vertical Handoff Decision Algorithm for Heterogeneous Wireless NetworksIEEE Transactions on Vehicular Technology, 2008
- Adaptive resource allocation in multiuser OFDM systems with proportional rate constraintsIEEE Transactions on Wireless Communications, 2005