Research and Verification of Convolutional Neural Network Lightweight in BCI.

Journal: Computational and mathematical methods in medicine
Published Date:

Abstract

With the increasing of depth and complexity of the convolutional neural network, parameter dimensionality and volume of computing have greatly restricted its applications. Based on the SqueezeNet network structure, this study introduces a block convolution and uses channel shuffle between blocks to alleviate the information jam. The method is aimed at reducing the dimensionality of parameters of in an original network structure and improving the efficiency of network operation. The verification performance of the ORL dataset shows that the classification accuracy and convergence efficiency are not reduced or even slightly improved when the network parameters are reduced, which supports the validity of block convolution in structure lightweight. Moreover, using a classic CIFAR-10 dataset, this network decreases parameter dimensionality while accelerating computational processing, with excellent convergence stability and efficiency when the network accuracy is only reduced by 1.3%.

Authors

  • Shipu Xu
    Department of Software Engineering, Tongji University, Shanghai 201804, China.
  • Runlong Li
    Department of Railway Transportation, Shanghai Institute of Technology, Shanghai 201418, China.
  • Yunsheng Wang
    Agricultural Information Institutes of Science and Technology, Shanghai Academy of Agricultural Sciences, Shanghai 201403, China.
  • Yong Liu
    Department of Critical care medicine, Shenzhen Hospital, Southern Medical University, Guangdong, Shenzhen, China.
  • Wenwen Hu
    Agricultural Information Institutes of Science and Technology, Shanghai Academy of Agricultural Sciences, Shanghai 201403, China.
  • Yingjing Wu
    Agricultural Information Institutes of Science and Technology, Shanghai Academy of Agricultural Sciences, Shanghai 201403, China.
  • Chenxi Zhang
    Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, No. 1 Shuaifuyuan Wangfujing, Dongcheng District, Beijing, 100730, China.
  • Chang Liu
    Key Lab of Cell Differentiation and Apoptosis of Ministry of Education, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
  • Chao Ma