Medical knowledge embedding based on recursive neural network for multi-disease diagnosis.

Journal: Artificial intelligence in medicine
Published Date:

Abstract

The representation of knowledge based on first-order logic captures the richness of natural language and supports multiple probabilistic inference models. Although symbolic representation enables quantitative reasoning with statistical probability, it is difficult to utilize with machine learning models as they perform numerical operations. In contrast, knowledge embedding (i.e., high-dimensional and continuous vectors) is a feasible approach to complex reasoning that can not only retain the semantic information of knowledge, but also establish the quantifiable relationship among embeddings. In this paper, we propose a recursive neural knowledge network (RNKN), which combines medical knowledge based on first-order logic with a recursive neural network for multi-disease diagnosis. After the RNKN is efficiently trained using manually annotated Chinese Electronic Medical Records (CEMRs), diagnosis-oriented knowledge embeddings and weight matrixes are learned. The experimental results confirm that the diagnostic accuracy of the RNKN is superior to those of four machine learning models, four classical neural networks and Markov logic network. The results also demonstrate that the more explicit the evidence extracted from CEMRs, the better the performance. The RNKN gradually reveals the interpretation of knowledge embeddings as the number of training epochs increases.

Authors

  • Jingchi Jiang
    School of Computer Science and Technology, Harbin Institute of Technology, Integrated Laboratory Building 803, Harbin 150001, China. Electronic address: jiangjingchi0118@163.com.
  • Huanzheng Wang
    School of Computer Science and Technology, Harbin Institute of Technology, Integrated Laboratory Building 803, Harbin 150001, China. Electronic address: whz123_hit@163.com.
  • Jing Xie
    Department of Critical Care Medicine, The First Affiliated Hospital, Fujian Medical University, Fuzhou, China.
  • Xitong Guo
    School of Management, Harbin Institute of Technology, Harbin 150001, China. Electronic address: xitongguo@hit.edu.cn.
  • Yi Guan
    School of Computer Science and Technology, Harbin Institute of Technology, Integrated Laboratory Building 803, Harbin 150001, China. Electronic address: guanyi@hit.edu.cn.
  • Qiubin Yu
    Medical Record Room, Second Affiliated Hospital of Harbin Medical University, Harbin 150086, China. Electronic address: yuqiubin6695@163.com.