Learning With Stochastic Guidance for Robot Navigation.
IEEE Trans Neural Netw Learn Syst
; 32(1): 166-176, 2021 Jan.
Article
en En
| MEDLINE
| ID: mdl-32203029
Due to the sparse rewards and high degree of environmental variation, reinforcement learning approaches, such as deep deterministic policy gradient (DDPG), are plagued by issues of high variance when applied in complex real-world environments. We present a new framework for overcoming these issues by incorporating a stochastic switch, allowing an agent to choose between high- and low-variance policies. The stochastic switch can be jointly trained with the original DDPG in the same framework. In this article, we demonstrate the power of the framework in a navigation task, where the robot can dynamically choose to learn through exploration or to use the output of a heuristic controller as guidance. Instead of starting from completely random actions, the navigation capability of a robot can be quickly bootstrapped by several simple independent controllers. The experimental results show that with the aid of stochastic guidance, we are able to effectively and efficiently train DDPG navigation policies and achieve significantly better performance than state-of-the-art baseline models.
Texto completo:
1
Colección:
01-internacional
Base de datos:
MEDLINE
Tipo de estudio:
Guideline
Idioma:
En
Revista:
IEEE Trans Neural Netw Learn Syst
Año:
2021
Tipo del documento:
Article
Pais de publicación:
Estados Unidos