Robotic action acquisition with cognitive biases in coarse-grained state space.

Journal: Bio Systems
Published Date:

Abstract

Some of the authors have previously proposed a cognitively inspired reinforcement learning architecture (LS-Q) that mimics cognitive biases in humans. LS-Q adaptively learns under uniform, coarse-grained state division and performs well without parameter tuning in a giant-swing robot task. However, these results were shown only in simulations. In this study, we test the validity of the LS-Q implemented in a robot in a real environment. In addition, we analyze the learning process to elucidate the mechanism by which the LS-Q adaptively learns under the partially observable environment. We argue that the LS-Q may be a versatile reinforcement learning architecture, which is, despite its simplicity, easily applicable and does not require well-prepared settings.

Authors

  • Daisuke Uragami
    College of Industrial Technology, Nihon University, 1-2-1, Izumi, Narashino, Chiba, 275-8575, Japan. Electronic address: dduragami@gmail.com.
  • Yu Kohno
    Graduate School of Advanced Science and Technology, Tokyo Denki University, Hatoyama, Hiki, Saitama, 350-0394, Japan. Electronic address: yu.kohno02@gmail.com.
  • Tatsuji Takahashi
    School of Science and Technology, Tokyo Denki University, Hatoyama, Hiki, Saitama, 350-0394, Japan. Electronic address: tatsuji.takahashi@gmail.com.