Mobile robot navigation: neural Q-learning
by S. Parasuraman; Soh Chin Yun
International Journal of Computer Applications in Technology (IJCAT), Vol. 44, No. 4, 2012

Abstract: This paper presents the mobile robot navigation technique which utilises Reinforcement Learning (RL) algorithms and Artificial Neural Network (ANN) to learn in an unknown environment for mobile robot navigation. This research study is focused on the integration of multi-layer neural network and Q-learning as online learning control scheme. This process is divided into two stages. In the initial stage, the agent will map the environment through collecting state-action information according to the Q-learning procedure. Second training process involves neural network which utilises the state-action information gathered in the earlier phase of training samples. During final application of the controller, Q-learning would be used as primary navigating tool whereas the trained neural network will be employed when approximation is needed. MATLAB simulation was developed to verify and validate the algorithm before real-time implementation using Team AmigoBot™ robot. The results obtained from both simulation and real world experiments are discussed.

Online publication date: Mon, 29-Oct-2012

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Computer Applications in Technology (IJCAT):
Login with your Inderscience username and password:

    Username:        Password:         

Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email