Ternary spike-based neuromorphic signal processing system.

Journal: Neural networks : the official journal of the International Neural Network Society
PMID:

Abstract

Deep Neural Networks (DNNs) have been successfully implemented across various signal processing fields, resulting in significant enhancements in performance. However, DNNs generally require substantial computational resources, leading to significant economic costs and posing challenges for their deployment on resource-constrained edge devices. In this study, we take advantage of spiking neural networks (SNNs) and quantization technologies to develop an energy-efficient and lightweight neuromorphic signal processing system. Our system is characterized by two principal innovations: a threshold-adaptive encoding (TAE) method and a quantized ternary SNN (QT-SNN). The TAE method can efficiently encode time-varying analog signals into sparse ternary spike trains, thereby reducing energy and memory demands for signal processing. QT-SNN, compatible with ternary spike trains from the TAE method, quantifies both membrane potentials and synaptic weights to reduce memory requirements while maintaining performance. Extensive experiments are conducted on two typical signal-processing tasks: speech and electroencephalogram recognition. The results demonstrate that our neuromorphic signal processing system achieves state-of-the-art (SOTA) performance with a 94% reduced memory requirement. Furthermore, through theoretical energy consumption analysis, our system shows 7.5× energy saving compared to other SNN works. The efficiency and efficacy of the proposed system highlight its potential as a promising avenue for energy-efficient signal processing.

Authors

  • Shuai Wang
    Department of Intensive Care Unit, China-Japan Union Hospital of Jilin University, Changchun, China.
  • Dehao Zhang
    Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China.
  • Ammar Belatreche
  • Yichen Xiao
    Eye Institute and Department of Ophthalmology, Eye and ENT Hospital, Fudan University, Shanghai, 200031, China; NHC Key Laboratory of Myopia (Fudan University), Key Laboratory of Myopia, Chinese Academy of Medical Sciences, Shanghai, 200031, China; Shanghai Research Center of Ophthalmology and Optometry, Shanghai, 200031, China; Shanghai Key Laboratory of Visual Impairment and Restoration, Shanghai, 200031, China. Electronic address: yichenxiao@fudan.edu.cn.
  • Hongyu Qing
    Department of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China.
  • Wenjie Wei
    Department of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China.
  • Malu Zhang
    Department of Computer Science and Engineering, University of Electronic Science and Technology of China, 611731, Chengdu, Sichuan, China.
  • Yang Yang
    Department of Gastrointestinal Surgery, The Third Hospital of Hebei Medical University, Shijiazhuang, China.