Optimal Channel-Sensing Scheme for Cognitive Radio Systems Based on Fuzzy Q-Learning

Fereidoun H. PANAHI  Tomoaki OHTSUKI  

IEICE TRANSACTIONS on Communications   Vol.E97-B    No.2    pp.283-294
Publication Date: 2014/02/01
Online ISSN: 1745-1345
DOI: 10.1587/transcom.E97.B.283
Print ISSN: 0916-8516
Type of Manuscript: Special Section PAPER (Special Section on Technologies for Effective Utilization of Spectrum White Space)
cognitive radio (CR),  partially observable Markov decision process (POMDP),  Fuzzy Q-Learning (FQL),  Baum-Welch Algorithm (BWA),  

Full Text: PDF(2.2MB)>>
Buy this Article

In a cognitive radio (CR) network, the channel sensing scheme used to detect the existence of a primary user (PU) directly affects the performances of both CR and PU. However, in practical systems, the CR is prone to sensing errors due to the inefficiency of the sensing scheme. This may yield primary user interference and low system performance. In this paper, we present a learning-based scheme for channel sensing in CR networks. Specifically, we formulate the channel sensing problem as a partially observable Markov decision process (POMDP), where the most likely channel state is derived by a learning process called Fuzzy Q-Learning (FQL). The optimal policy is derived by solving the problem. Simulation results show the effectiveness and efficiency of our proposed scheme.