CLASEG: advanced multiclassification and segmentation for differential diagnosis of oral lesions using deep learning.

Journal: Scientific reports
Published Date:

Abstract

Oral cancer has a high mortality rate primarily due to delayed diagnoses, highlighting the need for early detection of oral lesions. This study presents a novel deep learning framework for multi-class classification-based segmentation, enabling accurate differential diagnosis of 14 common oral lesions-benign, pre-malignant, and malignant-across various mouth locations using photographic images. A dataset of 2,072 clinical images was used to train and validate the model. The proposed framework integrates EfficientNet-B3 for classification and ResNet-101-based Mask R-CNN for segmentation, achieving a classification accuracy of 74.49% and segmentation performance with an average precision (AP50) of 72.18. The gradient-weighted class activation map technique was applied to the model outputs to enable visualization of the specific areas that were most influential for predictive decisions made by the model. This significantly improves upon the state-of-the-art, where previous models achieved lower segmentation accuracy (AP50 < 50%). The framework not only classifies the lesion type but also delineates the lesion boundaries with high precision, which is critical for early detection and differential diagnosis in clinical practice.

Authors

  • Afnan Al-Ali
    Computer Science and Engineering Department, Qatar University, Doha, Qatar.
  • Ali Hamdi
    MSA University, Giza, Egypt.
  • Mohamed Elshrif
    Qatar Computing Research Institute, HBKU, Doha, Qatar.
  • Keivin Isufaj
    Qatar Computing Research Institute, HBKU, Doha, Qatar.
  • Khaled Shaban
    Computer Science and Engineering Department, Qatar University, Doha, Qatar.
  • Peter Chauvin
    Faculty of Dental Medicine and Oral Health Sciences, McGill University, Montreal, Canada.
  • Sreenath Madathil
    Faculty of Dental Medicine and Oral Health Sciences, McGill University, Montreal, QC, Canada.
  • Ammar Daer
    Faculty of Dental Medicine and Oral Health Sciences, McGill University, Montreal, Canada.
  • Faleh Tamimi
    College of Dental Medicine, QU Health, Qatar University, Doha, Qatar.
  • Raidan Ba-Hattab
    Pre-Clinical Oral Health Sciences Department, College of Dental Medicine, QU Health, Qatar University, P.O. Box: 2713, Doha, Qatar. rbahattab@qu.edu.qa.