Deep Upscale U-Net for automatic tongue segmentation.

Journal: Medical & biological engineering & computing
Published Date:

Abstract

In a treatment or diagnosis related to oral health conditions such as oral cancer and oropharyngeal cancer, an investigation of tongue's movements is a major part. In an automatic measurement of such movement, it must first start with a task of tongue segmentation. This paper proposes a solution of tongue segmentation based on a decoder-encoder CNN-based structure i.e., U-Net. However, it could suffer from a problem of feature loss in deep layers. This paper proposes a Deep Upscale U-Net (DU-UNET). An additional up-sampling of the feature map from a contracting path is concatenated to an upper layer of an expansive path, based on an original U-Net structure. The segmentation model is constructed by training DU-UNET on the two publicly available datasets, and transferred to the self-collected dataset of tongue images with five tongue postures which were recorded at a far distance from a camera under a real-world scenario. The proposed DU-UNET outperforms the other existing methods in our literature reviews, with accuracy of 99.2%, mean IoU of 97.8%, Dice score of 96.8%, and Jaccard score of 96.8%.

Authors

  • Worapan Kusakunniran
    Faculty of Information and Communication Technology, Mahidol University, 999 Phuttamonthon 4 Road, Salaya, 73170, Nakhon Pathom, Thailand. worapan.kun@mahidol.edu.
  • Thanandon Imaromkul
    Faculty of Information and Communication Technology, Mahidol University, 999 Phuttamonthon 4 Road, Salaya, 73170, Nakhon Pathom, Thailand.
  • Sophon Mongkolluksamee
    Department of Computer Science, Faculty of Science, Srinakharinwirot University, 114 Sukhumvit 23, 10110, Bangkok, Thailand.
  • Kittikhun Thongkanchorn
    Faculty of Information and Communication Technology, Mahidol University, 999 Phuttamonthon 4 Road, Salaya, 73170, Nakhon Pathom, Thailand.
  • Panrasee Ritthipravat
    Department of Biomedical Engineering, Faculty of Engineering, Mahidol University, 999 Phuttamonthon 4 Road, Salaya, 73170, Nakhon Pathom, Thailand. panrasee.rit@mahidol.ac.th.
  • Pimchanok Tuakta
    Department of Rehabilitation Medicine, Faculty of Medicine Ramathibodi Hospital, Mahidol University, 270 Rama 6 Road, 10400, Bangkok, Thailand.
  • Paitoon Benjapornlert
    Department of Rehabilitation Medicine, Faculty of Medicine Ramathibodi Hospital, Mahidol University, 270 Rama 6 Road, 10400, Bangkok, Thailand.