Emergence of associative learning in a neuromorphic inference network.

Journal: Journal of neural engineering
Published Date:

Abstract

. In the theoretical framework of predictive coding and active inference, the brain can be viewed as instantiating a rich generative model of the world that predicts incoming sensory data while continuously updating its parameters via minimization of prediction errors. While this theory has been successfully applied to cognitive processes-by modelling the activity of functional neural networks at a mesoscopic scale-the validity of the approach when modelling neurons as an ensemble of inferring agents, in a biologically plausible architecture, remained to be explored.We modelled a simplified cerebellar circuit with individual neurons acting as Bayesian agents to simulate the classical delayed eyeblink conditioning protocol. Neurons and synapses adjusted their activity to minimize their prediction error, which was used as the network cost function. This cerebellar network was then implemented in hardware by replicating digital neuronal elements via a low-power microcontroller.. Persistent changes of synaptic strength-that mirrored neurophysiological observations-emerged via local (neurocentric) prediction error minimization, leading to the expression of associative learning. The same paradigm was effectively emulated in low-power hardware showing remarkably efficient performance compared to conventional neuromorphic architectures.. These findings show that: (a) an ensemble of free energy minimizing neurons-organized in a biological plausible architecture-can recapitulate functional self-organization observed in nature, such as associative plasticity, and (b) a neuromorphic network of inference units can learn unsupervised tasks without embedding predefined learning rules in the circuit, thus providing a potential avenue to a novel form of brain-inspired artificial intelligence.

Authors

  • Daniela Gandolfi
    Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Modena, Italy.
  • Francesco M Puglisi
    Department of Engineering 'Enzo Ferrari', University of Modena and Reggio Emilia, Modena, Italy.
  • Giulia M Boiani
    Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Modena, Italy.
  • Giuseppe Pagnoni
    Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Modena, Italy.
  • Karl J Friston
    Wellcome Trust Centre for Neuroimaging, University College London, London, United Kingdom.
  • Egidio D'Angelo
    Department of Brain and Behavioral Sciences, University of Pavia, Brain Connectivity Center Istituto Neurologico IRCCS Fondazione C. Mondino, Pavia, Italy.
  • Jonathan Mapelli
    Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Modena, Italy.