Reinforcement Learning-Based Multislot Double-Threshold Spectrum Sensing With Bayesian Fusion for Industrial Big Spectrum Data

Abstract

With the rapid increase of industrial systems, industrial spectrum is stepping into the era of big data, and at the same time spectrum resources are facing serious shortage. Cognitive industrial system (CIS) based on cognitive radio can improve spectrum utilization by accessing the idle spectrum licensed to primary user (PU). However, the CIS must find enough idle channels by performing spectrum sensing. In this paper, a reinforcement learning-based multislot double-threshold spectrum sensing with Bayesian fusion is proposed to sense industrial big spectrum data, which can find required idle channels faster while guaranteeing spectrum sensing performance. Double thresholds are set to guarantee both high detection probability and spectrum access probability, and weighed energy detection is proposed to maximize detection probability when the energy statistic falls into the confusion area between the double thresholds. Bayesian fusion is proposed get a final decision on the channel availability by combining the local sensing decisions of all the time slots. An idle channel prediction and selection algorithm is proposed to predict the idle probability of each channel and find required idle channels from the sorted channel set. From simulation results, the proposed spectrum sensing scheme outperforms cooperative spectrum sensing and energy detection, which can predict idle channels accurately and get needed idle channels with fewer sensing operations.