Identifying individuals with recent COVID-19 through voice classification using deep learning.

Journal: Scientific reports
Published Date:

Abstract

Recently deep learning has attained a breakthrough in model accuracy for the classification of images due mainly to convolutional neural networks. In the present study, we attempted to investigate the presence of subclinical voice feature alteration in COVID-19 patients after the recent resolution of disease using deep learning. The study was a prospective study of 76 post COVID-19 patients and 40 healthy individuals. The diagnoses of post COVID-19 patients were based on more than the eighth week after onset of symptoms. Voice samples of an 'ah' sound, coughing sound and a polysyllabic sentence were collected and preprocessed to log-mel spectrogram. Transfer learning using the VGG19 pre-trained convolutional neural network was performed with all voice samples. The performance of the model using the polysyllabic sentence yielded the highest classification performance of all models. The coughing sound produced the lowest classification performance while the ability of the monosyllabic 'ah' sound to predict the recent COVID-19 fell between the other two vocalizations. The model using the polysyllabic sentence achieved 85% accuracy, 89% sensitivity, and 77% specificity. In conclusion, deep learning is able to detect the subtle change in voice features of COVID-19 patients after recent resolution of the disease.

Authors

  • Pichatorn Suppakitjanusant
    Chakri Naruebodindra Medical Institute, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Samut Prakan, Thailand.
  • Somnuek Sungkanuparph
    Chakri Naruebodindra Medical Institute, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Samut Prakan, Thailand.
  • Thananya Wongsinin
    Chakri Naruebodindra Medical Institute, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Samut Prakan, Thailand.
  • Sirapong Virapongsiri
    Chakri Naruebodindra Medical Institute, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Samut Prakan, Thailand.
  • Nittaya Kasemkosin
    Department of Communication Sciences and Disorders, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand.
  • Laor Chailurkit
    Division of Endocrinology and Metabolism, Department of Medicine, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Rama 6th Road, Bangkok, 10400, Thailand.
  • Boonsong Ongphiphadhanakul