CapsTM: capsule network for Chinese medical text matching.

Journal: BMC medical informatics and decision making
Published Date:

Abstract

BACKGROUND: Text Matching (TM) is a fundamental task of natural language processing widely used in many application systems such as information retrieval, automatic question answering, machine translation, dialogue system, reading comprehension, etc. In recent years, a large number of deep learning neural networks have been applied to TM, and have refreshed benchmarks of TM repeatedly. Among the deep learning neural networks, convolutional neural network (CNN) is one of the most popular networks, which suffers from difficulties in dealing with small samples and keeping relative structures of features. In this paper, we propose a novel deep learning architecture based on capsule network for TM, called CapsTM, where capsule network is a new type of neural network architecture proposed to address some of the short comings of CNN and shows great potential in many tasks.

Authors

  • Xiaoming Yu
  • Yedan Shen
    Department of Computer Science, Harbin Institute of Technology, Shenzhen, Guangdong, China.
  • Yuan Ni
    IBM Research, China, Beijing, China.
  • Xiaowei Huang
    School of Mechanical Engineering, Xi'an Jiaotong University, Xi'an, PR China.
  • Xiaolong Wang
    Cardiovascular Department, Shuguang Hospital Affiliated to Shanghai University of TCM Shanghai, China.
  • Qingcai Chen
    Key Laboratory of Network Oriented Intelligent Computation, Harbin Institute of Technology Shenzhen Graduate School, Shenzhen, Guangdong, China.
  • Buzhou Tang