Improving Interpretability of Leucocyte Classification with Multimodal Network.

Journal: Studies in health technology and informatics
PMID:

Abstract

White blood cell classification plays a key role in the diagnosis of hematologic diseases. Models can perform classification either from images or based on morphological features. Image-based classification generally yields higher performance, but feature-based classification is more interpretable for clinicians. In this study, we employed a Multimodal neural network to classify white blood cells, utilizing a combination of images and morphological features. We compared this approach with image-only and feature-only training. While the highest performance was achieved with image-only training, the Multimodal model provided enhanced interpretability by the computation of SHAP values, and revealed crucial morphological features for biological characterization of the cells.

Authors

  • Manon Chossegros
    Sorbonne Universite, Inserm, Universite Sorbonne Paris-Nord, Laboratoire d'Informatique Medicale et d'Ingenierie des Connaissances en e-Sante, LIMICS, France.
  • Xavier Tannier
    Sorbonne Université, Inserm, Univ Paris 13, Laboratoire d'Informatique Médicale et d'Ingénierie des Connaissances pour la e-Santé, LIMICS, 75006 Paris, France. Electronic address: xavier.tannier@sorbonne-universite.fr.
  • Daniel Stockholm
    Généthon, 91000, Evry, France. stockho@genethon.fr.