Dense Residual Network: Enhancing global dense feature flow for character recognition.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Deep Convolutional Neural Networks (CNNs), such as Dense Convolutional Network (DenseNet), have achieved great success for image representation learning by capturing deep hierarchical features. However, most existing network architectures of simply stacking the convolutional layers fail to enable them to fully discover local and global feature information between layers. In this paper, we mainly investigate how to enhance the local and global feature learning abilities of DenseNet by fully exploiting the hierarchical features from all convolutional layers. Technically, we propose an effective convolutional deep model termed Dense Residual Network (DRN) for the task of optical character recognition. To define DRN, we propose a refined residual dense block (r-RDB) to retain the ability of local feature fusion and local residual learning of original RDB, which can reduce the computing efforts of inner layers at the same time. After fully capturing local residual dense features, we utilize the sum operation and several r-RDBs to construct a new block termed global dense block (GDB) by imitating the construction of dense blocks to adaptively learn global dense residual features in a holistic way. Finally, we use two convolutional layers to design a down-sampling block to reduce the global feature size and extract more informative deeper features. Extensive results show that our DRN can deliver enhanced results, compared with other related deep models.

Authors

  • Zhao Zhang
  • Zemin Tang
    School of Computer Science and Technology, Soochow University, Suzhou 215006, China.
  • Yang Wang
    Department of General Surgery The First People's Hospital of Yunnan Province, The Affiliated Hospital of Kunming University of Science and Technology Kunming China.
  • Zheng Zhang
    Key Laboratory of Sustainable and Development of Marine Fisheries, Ministry of Agriculture and Rural Affairs, Yellow Sea Fisheries Research Institute, Chinese Academy of Fishery Sciences, Qingdao, PR China.
  • Choujun Zhan
    School of Computer, South China Normal University, Guangzhou 510631, China. Electronic address: zchoujun2@gmail.com.
  • Zhengjun Zha
    Department of Computer Science and Technology, University of Science and Technology of China, Hefei, China.
  • Meng Wang
    State Key Laboratory of Urban Water Resource and Environment, School of Environment, Harbin Institute of Technology, Harbin 150001, China.