Development and validation of a machine learning approach for screening new leprosy cases based on the leprosy suspicion questionnaire.

Journal: Scientific reports
PMID:

Abstract

Leprosy is a dermatoneurological disease and can cause irreversible nerve damage. In addition to being able to mimic different rheumatological, neurological and dermatological diseases, leprosy is underdiagnosed because several professionals present lack of training. The World Health Organization instituted active search for new leprosy cases as one of the four pillars of the zero-leprosy strategy. The Leprosy Suspicion Questionnaire (LSQ) was created aiming to be a screening tool to actively detect new cases; it is composed of 14 simple yes/no questions that can be answered with the help of a health professional or by the very patient themselves. During its development, it was noticed that the combination of marked questions was related to new case detections. To better encapsulate and being able to expand its use, we developed MaLeSQs, a Machine Learning tool whose output may be LSQ Positive when the subject is indicated for being further clinically evaluated or LSQ Negative when the subject does not present any evidence that justify being further evaluated for leprosy. To achieve a reasonable product, we trained four classifiers with different learning paradigms, Support Vectors Machine, Logistic Regression, Random Forest and XGBoost. We compared them based on sensitivity, specificity, positive predicted value, negative predicted value, and area under the ROC curve. After the training process, the Support Vectors Machine was the classifier with the most balanced metrics of 85.7% sensitivity, 69.2% specificity, 18.6% precision, 98.3% negative predicted values and an area under the ROC curve of 0.775, and it was chosen as the MaLeSQs. With Shapley values, we were able to evaluate variable importance and nerve symptoms were considered important to differentiate between subjects that potentially had leprosy from those who did not.

Authors

  • Mateus Mendonça Ramos Simões
    Dermatology Division, Department of Internal Medicine, National Referral Center for Sanitary Dermatology and Hansen's Disease, Clinical Hospital of the Ribeirão Preto Medical School, University of São Paulo, São Paulo, Brazil.
  • Filipe Rocha Lima
    Dermatology Division, Department of Internal Medicine, National Referral Center for Sanitary Dermatology and Hansen's Disease, Clinical Hospital of the Ribeirão Preto Medical School, University of São Paulo, São Paulo, Brazil.
  • Helena Barbosa Lugão
    Dermatology Division, Department of Internal Medicine, National Referral Center for Sanitary Dermatology and Hansen's Disease, Clinical Hospital of the Ribeirão Preto Medical School, University of São Paulo, São Paulo, Brazil.
  • Natália Aparecida de Paula
    Dermatology Division, Department of Internal Medicine, National Referral Center for Sanitary Dermatology and Hansen's Disease, Clinical Hospital of the Ribeirão Preto Medical School, University of São Paulo, São Paulo, Brazil.
  • Cláudia Maria Lincoln Silva
    Dermatology Division, Department of Internal Medicine, National Referral Center for Sanitary Dermatology and Hansen's Disease, Clinical Hospital of the Ribeirão Preto Medical School, University of São Paulo, São Paulo, Brazil.
  • Alexandre Ferreira Ramos
    Arts, Science and Humanities School, University of São Paulo, São Paulo, Brazil.
  • Marco Andrey Cipriani Frade
    Dermatology Division, Department of Internal Medicine, National Referral Center for Sanitary Dermatology and Hansen's Disease, Clinical Hospital of the Ribeirão Preto Medical School, University of São Paulo, São Paulo, Brazil. mandrey@fmrp.usp.br.