Biomimetic ferroelectric-semiconductor transistor enables neuronal multisensory integration.

Journal: Nature communications
Published Date:

Abstract

Human brain seamlessly integrates multisensory stimuli to synthesize complementary information for enhanced perceptions, depending on neural principles of superadditivity, inverse effectiveness, and temporal congruency. Replicating multisensory integration in artificial intelligences has remained challenging due to the inefficiency of algorithmic fusions and the absence of hardware-native mechanisms. Here, we demonstrate biomimetic audiovisual integration at the device level of Bi2O2Se ferroelectric-semiconductor field-effect transistors (FeS-FETs) through multiphysics coupling. Our FeS-FETs simultaneously accomplish the superadditive integration factor of 2800%, dynamical reweighting inputs of inverse effectiveness, and prolonged temporal congruency beyond 103 s. Furthermore, when configured into memristor-chip-based spiking neural networks, the resultant multisensory system is capable of executing the sensory synaptic plasticity, population-coded spiking, and Bayesian-optimal fusion, which promotes the excellent recognition accuracy of 98.2% for fuzzy objects, surpassing that identified from conventional fusion algorithms. By the exploration of multi-physical computing to mirror the biological multisensory hierarchy, we establish a physics-aware framework for neuromorphic multisensory intelligences, bridging physical dynamics with neurobiological principles for self-adaptive edge computing.

Authors

Keywords

No keywords available for this article.