DeepNAPSI multi-reader nail psoriasis prediction using deep learning.

Journal: Scientific reports
PMID:

Abstract

Nail psoriasis occurs in about every second psoriasis patient. Both, finger and toe nails can be affected and also severely destroyed. Furthermore, nail psoriasis is associated with a more severe course of the disease and the development of psoriatic arthritis. User independent quantification of nail psoriasis, however, is challenging due to the heterogeneous involvement of matrix and nail bed. For this purpose, the nail psoriasis severity index (NAPSI) has been developed. Experts grade pathological changes of each nail of the patient leading to a maximum score of 80 for all nails of the hands. Application in clinical practice, however, is not feasible due to the time-intensive manual grading process especially if more nails are involved. In this work we aimed to automatically quantify the modified NAPSI (mNAPSI) of patients using neuronal networks retrospectively. First, we performed photographs of the hands of patients with psoriasis, psoriatic arthritis, and rheumatoid arthritis. In a second step, we collected and annotated the mNAPSI scores of 1154 nail photos. Followingly, we extracted each nail automatically using an automatic key-point-detection system. The agreement among the three readers with a Cronbach's alpha of 94% was very high. With the nail images individually available, we trained a transformer-based neural network (BEiT) to predict the mNAPSI score. The network reached a good performance with an area-under-receiver-operator-curve of 88% and an area-under precision-recall-curve (PR-AUC) of 63%. We could compare the results with the human annotations and achieved a very high positive Pearson correlation of 90% by aggregating the predictions of the network on the test set to the patient-level. Lastly, we provided open access to the whole system enabling the use of the mNAPSI in clinical practice.

Authors

  • Lukas Folle
    Pattern Recognition Lab-Computer Science, Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), Erlangen, Germany. lukas.folle@fau.de.
  • Pauline Fenzl
    Department of Internal Medicine 3, Rheumatology and Immunology, Friedrich-Alexander-Universität Erlangen-Nürnberg and Universitätsklinikum Erlangen, Ulmenweg 18, 91054, Erlangen, Germany.
  • Filippo Fagni
    Department of Internal Medicine 3, Rheumatology and Immunology, Friedrich-Alexander-Universität Erlangen-Nürnberg and Universitätsklinikum Erlangen, Ulmenweg 18, 91054, Erlangen, Germany.
  • Mareike Thies
    Laboratory for Computational Sensing + Robotics, Johns Hopkins University, Baltimore, MD, USA.
  • Vincent Christlein
  • Christine Meder
    Deutsches Zentrum Immuntherapie, Friedrich-Alexander-Universität Erlangen-Nürnberg and Universitätsklinikum Erlangen, Ulmenweg 18, 91054, Erlangen, Germany.
  • David Simon
    Department of Internal Medicine 3-Rheumatology and Immunology, FAU Erlangen-Nürnberg and Universitätsklinikum Erlangen, Erlangen, Germany.
  • Ioanna Minopoulou
    Department of Internal Medicine 3, Rheumatology and Immunology, Friedrich-Alexander-Universität Erlangen-Nürnberg and Universitätsklinikum Erlangen, Ulmenweg 18, 91054, Erlangen, Germany.
  • Michael Sticherling
    Deutsches Zentrum Immuntherapie, Friedrich-Alexander-Universität Erlangen-Nürnberg and Universitätsklinikum Erlangen, Ulmenweg 18, 91054, Erlangen, Germany.
  • Georg Schett
    Department of Internal Medicine 3-Rheumatology and Immunology, FAU Erlangen-Nürnberg and Universitätsklinikum Erlangen, Erlangen, Germany.
  • Andreas Maier
    Pattern Recognition Lab, University Erlangen-Nürnberg, Erlangen, Germany.
  • Arnd Kleyer
    Department of Internal Medicine 3-Rheumatology and Immunology, FAU Erlangen-Nürnberg and Universitätsklinikum Erlangen, Erlangen, Germany.