Bio-inspired multimodal learning with organic neuromorphic electronics for behavioral conditioning in robotics.

Journal: Nature communications
Published Date:

Abstract

Biological systems interact directly with the environment and learn by receiving multimodal feedback via sensory stimuli that shape the formation of internal neuronal representations. Drawing inspiration from biological concepts such as exploration and sensory processing that eventually lead to behavioral conditioning, we present a robotic system handling objects through multimodal learning. A small-scale organic neuromorphic circuit locally integrates and adaptively processes multimodal sensory stimuli, enabling the robot to interact intelligently with its surroundings. The real-time handling of sensory stimuli via low-voltage organic neuromorphic devices with synaptic functionality forms multimodal associative connections that lead to behavioral conditioning, and thus the robot learns to avoid potentially dangerous objects. This work demonstrates that adaptive neuro-inspired circuitry with multifunctional organic materials, can accommodate locally efficient bio-inspired learning for advancing intelligent robotics.

Authors

  • Imke Krauhausen
    Microsystems, Institute for Complex Molecular Systems, Eindhoven University of Technology, Eindhoven, 5612 AE, The Netherlands.
  • Sophie Griggs
    Department of Chemistry, University of Oxford, Oxford, UK.
  • Iain McCulloch
    Department of Chemistry, University of Oxford, Oxford, UK.
  • Jaap M J den Toonder
    Institute for Complex Molecular Systems, Eindhoven University of Technology, Eindhoven, The Netherlands.
  • Paschalis Gkoupidenis
    Department of Bioelectronics, Ecole Nationale Supérieure des Mines, CMP-EMSE, MOC, Gardanne 13541, France.
  • Yoeri van de Burgt
    Microsystems, Institute for Complex Molecular Systems, Eindhoven University of Technology, Eindhoven, 5612 AE, The Netherlands.