Heterogeneous quantization regularizes spiking neural network activity.

Journal: Scientific reports
PMID:

Abstract

The learning and recognition of object features from unregulated input has been a longstanding challenge for artificial intelligence systems. Brains, on the other hand, are adept at learning stable sensory representations given noisy observations, a capacity mediated by a cascade of signal conditioning steps informed by domain knowledge. The olfactory system, in particular, solves a source separation and denoising problem compounded by concentration variability, environmental interference, and unpredictably correlated sensor affinities using a plastic network that requires statistically well-behaved input. We present a data-blind neuromorphic signal conditioning strategy, based on the biological system architecture, that normalizes and quantizes analog data into spike-phase representations, thereby transforming uncontrolled sensory input into a regular form with minimal information loss. Normalized input is delivered to a column of spiking principal neurons via heterogeneous synaptic weights; this gain diversification strategy regularizes neuronal utilization, yoking total activity to the network's operating range and rendering internal representations robust to uncontrolled open-set stimulus variance. To dynamically optimize resource utilization while balancing activity regularization and resolution, we supplement this mechanism with a data-aware calibration strategy in which the range and density of the quantization weights adapt to accumulated input statistics.

Authors

  • Roy Moyal
    Computational Physiology Lab, Department of Psychology, Cornell University, Ithaca, NY, 14853, USA. rm875@cornell.edu.
  • Kyrus R Mama
    Computational Physiology Lab, Department of Psychology, Cornell University, Ithaca, NY, 14853, USA.
  • Matthew Einhorn
    Computational Physiology Lab, Department of Psychology, Cornell University, Ithaca, NY, 14853, USA.
  • Ayon Borthakur
    Mehta Family School of Data Science and Artificial Intelligence, IIT Guwahati, Guwahati, Assam, 781039, India.
  • Thomas A Cleland
    Computational Physiology Lab, Department of Psychology, Cornell University, Ithaca, NY, 14853, USA. tac29@cornell.edu.