Optimal STI controls for HIV patients based on an efficient deep Q learning method.

Journal: Journal of theoretical biology
PMID:

Abstract

We investigate an efficient computational tool to suggest useful treatment regimens for people infected with the human immunodeficiency virus (HIV). Structured treatment interruption (STI) is a regimen in which therapeutic drugs are periodically administered and withdrawn to give patients relief from an arduous drug therapy. Numerous studies have been conducted to find better STI treatment strategies using various computational tools with mathematical models of HIV infection. In this paper, we leverage a modified version of the double deep Q network with prioritized experience replay to improve the performance of classic deep learning algorithms. Numerical simulation results show that our methodology produces significantly more optimal cost values for shorter treatment periods compared to other recent studies. Furthermore, our proposed algorithm performs well in one-day segment scenarios, whereas previous studies only reported results for five-day segment scenarios.

Authors

  • Changyeon Yoon
    Department of Mathematical Sciences, Seoul National University, 1, Gwanak-ro, Gwanak-gu, 08826, Seoul, Republic of Korea.
  • Jaemoo Choi
    Department of Mathematical Sciences, Seoul National University, 1, Gwanak-ro, Gwanak-gu, 08826, Seoul, Republic of Korea.
  • Hee-Dae Kwon
    Department of Mathematics, Inha University, 100, Inha-ro, Michuhol-gu, 22212, Incheon, Republic of Korea. Electronic address: hdkwon@inha.ac.kr.
  • Myungjoo Kang
    Department of Mathematical Sciences, Seoul National University, 1, Gwanak-ro, Gwanak-gu, 08826, Seoul, Republic of Korea. Electronic address: mkang@snu.ac.kr.