Regret of Multi-Channel Bandit Game in Cognitive Radio Networks

• Main Authors: Ma Jun, Zhang Yonghong
• Format: Article
• Language: English
• Published: EDP Sciences 2016-01-01
• Series: MATEC Web of Conferences
• Subjects: cognitive radio networks; adversarial bandit problem; congestion game; online learning; dynamic spectrum access
• Online Access: http://dx.doi.org/10.1051/matecconf/20165605002

The problem of how to evaluate the rate of convergence to Nash equilibrium solutions in the process of channel selection under incomplete information is studied. In this paper, the definition of regret is used to reflect the convergence rates of online algorithms. The process of selecting an idle channel for each secondary user is modeled as a multi-channel bandit game. The definition of the maximal averaged regret is given. Two existing online learning algorithms are used to obtain the Nash equilibrium for each SU. The maximal averaged regrets are used to evaluate the performances of online algorithms. When there is a pure strategy Nash equilibrium in the multi-channel bandit game, the maximal averaged regrets are finite. A cooperation mechanism is also needed in the process of calculating the maximal averaged regrets. Simulation results show the maximal averaged regrets are finite and the online algorithm with greater convergence rate has less maximal averaged regrets.