A multisynaptic spiking neuron for simultaneously encoding spatiotemporal dynamics.

Journal: Nature communications
Published Date:

Abstract

Spiking neural networks (SNNs) are biologically more plausible and computationally more powerful than artificial neural networks due to their intrinsic temporal dynamics. However, vanilla spiking neurons struggle to simultaneously encode spatiotemporal dynamics of inputs. Inspired by biological multisynaptic connections, we propose the Multi-Synaptic Firing (MSF) neuron, where an axon can establish multiple synapses with different thresholds on a postsynaptic neuron. MSF neurons jointly encode spatial intensity via firing rates and temporal dynamics via spike timing, and generalize Leaky Integrate-and-Fire (LIF) and ReLU neurons as special cases. We derive optimal threshold selection and parameter optimization criteria for surrogate gradients, enabling scalable deep MSF-based SNNs without performance degradation. Extensive experiments across various benchmarks show that MSF neurons significantly outperform LIF neurons in accuracy while preserving low power, low latency, and high execution efficiency, and surpass ReLU neurons in event-driven tasks. Overall, this work advances neuromorphic computing toward real-world spatiotemporal applications.

Authors

  • Liangwei Fan
    College of Intelligence Science and Technology, National University of Defense Technology, Changsha, People's Republic of China.
  • Hui Shen
    College of Mechatronics and Automation, National University of Defense Technology, Changsha, China.
  • Xiangkai Lian
    College of Intelligence Science and Technology, National University of Defense Technology, Changsha, Hunan, China.
  • Yulin Li
    Department of Physics, and Fujian Provincial Key Laboratory for Soft Functional Materials Research, Xiamen University, Xiamen 361005, China.
  • Man Yao
    School of Automation Science and Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi 710049, China; Peng Cheng Laboratory, Shenzhen 518000, China. Electronic address: manyao@stu.xjtu.edu.cn.
  • Guoqi Li
    University of Chinese Academy of Sciences, Beijing 100049, China.
  • Dewen Hu