Fluorescence images of skin lesions and automated diagnosis using convolutional neural networks.

Journal: Photodiagnosis and photodynamic therapy
PMID:

Abstract

In recent years, interest in applying deep learning (DL) to medical diagnosis has rapidly increased, driven primarily by the development of Convolutional Neural Networks and Transformers. Despite advancements in DL, the automated diagnosis of skin cancer remains a significant challenge. Emulating dermatologists, deep learning approaches using clinical images acquired from smartphones and considering patient lesion information have achieved performance levels close to those of specialists. While including clinical information, such as whether the lesion bleeds, hurts, or itches, improves diagnostic metrics, it is insufficient for correctly differentiating some major skin cancer lesions. An alternate technology for diagnosing skin cancer is fluorescence widefield imaging, where the skin lesion is illuminated with excitation light, causing it to emit fluorescence. Since there is no public dataset of fluorescence images for skin lesions, to the best of our knowledge, an effort has been made and resulted in 1,563 fluorescence images of major skin lesions taken by smartphones using the handheld LED wieldfield fluorescence device. The collected images were annotated and analyzed, creating a new dataset named FLUO-SC. Convolutional neural networks were then applied to classify skin lesions using these fluorescence images. Experimental results indicate that fluorescence images are competitive with clinical images (baseline) for classifying major skin lesions and show promising potential for discrimination.

Authors

  • Matheus B Rocha
    Labcin - Nature Inspired Computing Laboratory, Federal University of Espírito Santo, Vitória, Brazil; Graduate Program in Computer Science, Federal University of Espírito Santo, Vitória, Brazil. Electronic address: matheusbecali@gmail.com.
  • Sebastiao Pratavieira
    Sao Carlos Institute of Physics, University of São Paulo, São Carlos, Brazil. Electronic address: prata@ifsc.usp.br.
  • Renan Souza Vieira
    Dermatological Assistance Program (PAD), Federal University of Espírito Santo, Vitória, Brazil.
  • Juliana Duarte Geller
    Dermatological Assistance Program (PAD), Federal University of Espírito Santo, Vitória, Brazil.
  • Amanda Lima Mutz Stein
    Dermatological Assistance Program (PAD), Federal University of Espírito Santo, Vitória, Brazil.
  • Fernanda Sales Soares de Oliveira
    Dermatological Assistance Program (PAD), Federal University of Espírito Santo, Vitória, Brazil.
  • Tania R P Canuto
    Dermatological Assistance Program (PAD), Federal University of Espírito Santo, Vitória, Brazil; Secretary of Health of the Espírito Santo State, Governor of Espírito Santo state, Vitória, Brazil.
  • Luciana de Paula Vieira
    Dermatological Assistance Program (PAD), Federal University of Espírito Santo, Vitória, Brazil; Secretary of Health of the Espírito Santo State, Governor of Espírito Santo state, Vitória, Brazil.
  • Renan Rossoni
    Dermatological Assistance Program (PAD), Federal University of Espírito Santo, Vitória, Brazil.
  • Maria C S Santos
    Pathological Anatomy Unit of the University Hospital Cassiano Antônio Moraes (HUCAM), Federal University of Espírito Santo, Vitória, Brazil.
  • Patricia H L Frasson
    Department of Specialized Medicine, Federal University of Espírito Santo, Vitória, Brazil; Dermatological Assistance Program (PAD), Federal University of Espírito Santo, Vitória, Brazil.
  • Renato A Krohling
    Graduate Program in Computer Science, PPGI, UFES - Federal University of Espírito Santo, Av. Fernando Ferrari 514, Vitória CEP: 29060-270, Brazil; Production Engineering Department, UFES - Federal University of Espírito Santo, Av. Fernando Ferrari 514, Vitória CEP: 29060-270, Brazil. Electronic address: rkrohling@inf.ufes.br.