J4 ›› 2011, Vol. 38 ›› Issue (4): 32-37.doi: 10.3969/j.issn.1001-2400.2011.04.006

• 研究论文 • 上一篇    下一篇



  1. (西安电子科技大学 综合业务网理论及关键技术国家重点实验室,陕西 西安  710071)
  • 收稿日期:2010-12-14 出版日期:2011-08-20 发布日期:2011-09-28
  • 通讯作者: 张文柱
  • 作者简介:张文柱(1970-),男,副教授,博士,E-mail: wzzhang1@mail.xidian.edu.cn.
  • 基金资助:


Dynamic spectrum allocation algorithm for heterogeneous radio networks based on reinforcement learning

ZHANG Wenzhu;SHAO Lina   

  1. (State Key Lab. of Integrated Service Networks, Xidian Univ., Xi'an  710071, China)
  • Received:2010-12-14 Online:2011-08-20 Published:2011-09-28
  • Contact: ZHANG Wenzhu



关键词: 异构无线网络, 动态频谱分配, 强化学习, 归一化径向基函数


An adaptive heuristic critic (AHC) Reinforcement Learning algorithm is presented for the dynamic spectrum allocation in an autonomously deciding mode in heterogeneous radio networks based on the normalized radial basis function (NRBF). The algorithm accelerates the learning speed by utilizing the NRBF when constructing the state space, and improves the learning efficiency by using the AHC scheme to reduce the unnecessary exploration. Through interactions with the radio environment, it learns to allocate the proper frequency band for each session in multiple radio access networks. Simulation results show that the proposed algorithm can lead to a better spectrum efficiency and quality of service compared with to the fixed frequency planning scheme or general dynamic spectrum allocation policy.

Key words: heterogeneous radio networks, dynamic spectrum allocation, reinforcement learning, normalized radial basis function


  • TP393