中文摘要：

无线异构网络中,接入控制机制是决定无线异构网络性能的关键因素之一.文中提出一种基于Q学习的无线异构网络接入控制的网络选择算法.系统中的学习者将会利用历史经验,通过迭代思想来执行Q学习算法,最终获得网络选择的最优策略.此外,在系统做出决策之前,算法从一个新的角度详细分析了WLAN/WIMAX无线异构网络的状态,为Q学习算法提供精确的底层决策输入参数.仿真数据表明：与传统的基于马尔科夫决策（MDP）的接入控制网络选择方案相比,新算法在呼叫阻塞率和系统回报最大化上都表现出了更加优良的性能.

英文摘要：

In wireless heterogeneous networks,the access control mechanism plays a vital role in ensuring the network performance.This paper proposes a Q-learning-based network selection algorithm for the access control of wireless heterogeneous networks.In the algorithm,the agent takes advantage of the past experience to implement a Q-learning algorithm by means of value iteration,thus obtaining the optimal strategy.Moreover,before the system makes decisions,the statuses of the wireless heterogeneous network of WLAN/WIMAX are analyzed in detail from a new perspective,thus providing accurate input bottom layer parameters for the Q-learning algorithm.Simulation results show that the proposed algorithm outperforms the traditional Markov Decision Process （MDP） algorithm in terms of the call-blocking probability and the system reward.