GUO Jin-chao, LIU Jie and CUI Guang-zhao. An improved Q-learning algorithm based on rough set[J]. Journal of Light Industry, 2013, 28(3): 42-45. doi: 10.3969/j.issn.2095-476X.2013.03.010
Citation:
GUO Jin-chao, LIU Jie and CUI Guang-zhao. An improved Q-learning algorithm based on rough set[J]. Journal of Light Industry, 2013, 28(3): 42-45.
doi:
10.3969/j.issn.2095-476X.2013.03.010
An improved Q-learning algorithm based on rough set
-
College of Electric and Information Engineering, Zhengzhou University of Light Industry, Zhengzhou 450002, China
-
Received Date:
2013-01-20
Available Online:
2013-05-15
-
Abstract
Q-learning algorithm has a fundamental flaw,that is,prone to error intervals overlap,and thus overestimation of the correct Q-value.These are likely to lead to low convergence speed and continuous decline in the performance of Q-learning,an improved Q-learning algorithm was proposed,that was rough sets Q-learning algorithm.The algorithm can be able to minimize the overestimation caused by Q-values and improve performance of learning through effectively deal with incomplete information and uncertain knowledge.Navigation experiments based on these two algorithms were conducted,the results showed that rough sets Q-learning algorithm had higher efficiency of learning and stronger ability of obstacle avoidance than Q-learning algorithm.
-
-
References
-
[1]
王雪松,程玉虎.机器学习理论、方法及应用[M].北京:科学出版社,2009.
-
[2]
James F Peters,Christopher Henry.Approximation spaces in off-policy Monte Carlo learning[J].Engineering Applications of Artificial Intelligence,2007(20):667.
-
[3]
Peng J, Williams R J. Incremental multi-step Q-learning[J].Machine Leaning,1996,22(1/3):283.
-
[4]
Pandey D,Pandey P.Approximate Q-learning:An introduction[C]//2010 Second International Conference on Machine Learning and Computing,Washington DC:IEEE Computer Society,2010.
-
[5]
邱玉霞.进化计算与粗糙集研究及应用[M].北京:冶金工业出版社,2009.
-
[6]
高庆吉.基于粗糙集理论的移动机器人自主导航研究[D].哈尔滨:哈尔滨工业大学,2006:15-16.
-
Proportional views
-
-