Prediction of coronary heart disease based on combined reinforcement multitask progressive time-series networks.

Journal: Methods (San Diego, Calif.)
Published Date:

Abstract

Coronary heart disease is the first killer of human health. At present, the most widely used approach of coronary heart disease diagnosis is coronary angiography, a surgery that could potentially cause some physical damage to the patients, together with some complications and adverse reactions. Furthermore, coronary angiography is expensive thus cannot be widely used in under development country. On the other hand, the heart color Doppler echocardiography report, blood biochemical indicators and personal information, such as gender, age and diabetes, can reflect the degree of heart damage in patients to some extent. This paper proposes a combined reinforcement multitask progressive time-series networks (CRMPTN) model to predict the grade of coronary heart disease through heart color Doppler echocardiography report, blood biochemical indicators and ten basic body information items about the patients. In this model, the first step is to perform deep reinforcement learning (DRL) pre-training through asynchronous advantage actor-critic (A3C). Training data is adopted to optimize the recurrent neural network (RNN) that parameterizes the stochastic policy. In the second step, soft parameter sharing module, hard parameter sharing module and progressive time-series networks are used to predict the status of coronary heart disease. The experimental results show that after DRL pre-training, the multiple tasks in the model interact with each other and learn together to achieve satisfactory results and outperform other state-of-the-art methods.

Authors

  • Wenqi Li
    Wellcome / EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, UK. Electronic address: wenqi.li@ucl.ac.uk.
  • Ming Zuo
    Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, China. Electronic address: zm@rjh.com.cn.
  • Hongjin Zhao
    Veterinary Diagnostic Center, Shanghai Animal Disease Control Center, Shanghai, China.
  • Qi Xu
    State Key Lab of Urban and Regional Ecology, Research Center for Eco-Environmental Sciences, Chinese Academy of Sciences, Beijing 100085, China; Henan Institute of Advanced Technology, Zhengzhou University, Zhengzhou 450052, China.
  • Dehua Chen
    Jiangsu Key Laboratory of Crop Genetics and Physiology, Co-Innovation Center for Modern Production Technology of Grain Crops, Yangzhou University, Yangzhou, Jiangsu, China.