Bioinspired and Low-Power 2D Machine Vision with Adaptive Machine Learning and Forgetting.

Journal: ACS nano
Published Date:

Abstract

Natural intelligence has many dimensions, with some of its most important manifestations being tied to learning about the environment and making behavioral changes. In primates, vision plays a critical role in learning. The underlying biological neural networks contain specialized neurons and synapses which not only sense and process visual stimuli but also learn and adapt with remarkable energy efficiency. Forgetting also plays an active role in learning. Mimicking the adaptive neurobiological mechanisms for seeing, learning, and forgetting can, therefore, accelerate the development of artificial intelligence (AI) and bridge the massive energy gap that exists between AI and biological intelligence. Here, we demonstrate a bioinspired machine vision system based on a 2D phototransistor array fabricated from large-area monolayer molybdenum disulfide (MoS) and integrated with an analog, nonvolatile, and programmable memory gate-stack; this architecture not only enables dynamic learning and relearning from visual stimuli but also offers learning adaptability under noisy illumination conditions at miniscule energy expenditure. In short, our demonstrated "all-in-one" hardware vision platform combines "sensing", "computing", and "storage" to not only overcome the von Neumann bottleneck of conventional complementary metal-oxide-semiconductor (CMOS) technology but also to eliminate the need for peripheral circuits and sensors.

Authors

  • Akhil Dodda
    Engineering Science and Mechanics, Penn State University, University Park, Pennsylvania 16802, United States.
  • Darsith Jayachandran
    Engineering Science and Mechanics, Penn State University, University Park, Pennsylvania 16802, United States.
  • Shiva Subbulakshmi Radhakrishnan
    Department of Engineering Science and Mechanics, Pennsylvania State University, University Park, PA, 16802, USA.
  • Andrew Pannone
    Department of Engineering Science and Mechanics, Pennsylvania State University, University Park, PA, 16802, USA.
  • Yikai Zhang
    Engineering Science and Mechanics, Penn State University, University Park, Pennsylvania 16802, United States.
  • Nicholas Trainor
    Materials Science and Engineering, Penn State University, University Park, Pennsylvania 16802, United States.
  • Joan M Redwing
    Materials Science and Engineering, Penn State University, University Park, Pennsylvania 16802, United States.
  • Saptarshi Das