Deep learning in diabetic foot ulcers detection: A comprehensive evaluation.

Journal: Computers in biology and medicine
Published Date:

Abstract

There has been a substantial amount of research involving computer methods and technology for the detection and recognition of diabetic foot ulcers (DFUs), but there is a lack of systematic comparisons of state-of-the-art deep learning object detection frameworks applied to this problem. DFUC2020 provided participants with a comprehensive dataset consisting of 2,000 images for training and 2,000 images for testing. This paper summarizes the results of DFUC2020 by comparing the deep learning-based algorithms proposed by the winning teams: Faster R-CNN, three variants of Faster R-CNN and an ensemble method; YOLOv3; YOLOv5; EfficientDet; and a new Cascade Attention Network. For each deep learning method, we provide a detailed description of model architecture, parameter settings for training and additional stages including pre-processing, data augmentation and post-processing. We provide a comprehensive evaluation for each method. All the methods required a data augmentation stage to increase the number of images available for training and a post-processing stage to remove false positives. The best performance was obtained from Deformable Convolution, a variant of Faster R-CNN, with a mean average precision (mAP) of 0.6940 and an F1-Score of 0.7434. Finally, we demonstrate that the ensemble method based on different deep learning methods can enhance the F1-Score but not the mAP.

Authors

  • Moi Hoon Yap
  • Ryo Hachiuma
    Keio University, Yokohama, Kanagawa, Japan.
  • Azadeh Alavi
    Baker Heart and Diabetes Institute, 20 Commercial Road, Melbourne, VIC, 3000, Australia.
  • Raphael Brungel
  • Bill Cassidy
    Faculty of Science and Engineering, Manchester Metropolitan University, John Dalton Building, Chester Street, Manchester, M1 5GD, UK.
  • Manu Goyal
    Department of Computing and Mathematics, Manchester Metropolitan University, UK.
  • Hongtao Zhu
    Shanghai University, Shanghai, 200444, China.
  • Johannes Rückert
    Department of Computer Science, University of Applied Sciences and Arts Dortmund (FH Dortmund), Emil-Figge-Str. 42, 44227 Dortmund, Germany.
  • Moshe Olshansky
    Baker Heart and Diabetes Institute, 20 Commercial Road, Melbourne, VIC, 3000, Australia.
  • Xiao Huang
    Department of Anesthesiology, Beijing Chao-Yang Hospital, Capital Medical University, No. 8 Workers' Stadium South Road, Beijing 100020, Chaoyang Distinct, China.
  • Hideo Saito
    Keio University, Yokohama, Kanagawa, Japan.
  • Saeed Hassanpour
    Lia Harrington, Todd MacKenzie, and Saeed Hassanpour, Geisel School of Medicine at Dartmouth College, Hanover; Roberta diFlorio-Alexander, Katherine Trinh, and Arief Suriawinata, Dartmouth-Hitchcock Medical Center, Lebanon, NH.
  • Christoph M Friedrich
    Department of Computer Science, University of Applied Sciences and Arts Dortmund, Dortmund, Germany.
  • David B Ascher
    Department of Biochemistry and Molecular Biology, University of Melbourne, Melbourne, Australia.
  • Anping Song
    Shanghai University, Shanghai, 200444, China.
  • Hiroki Kajita
    Keio University School of Medicine, Shinanomachi, Tokyo, Japan.
  • David Gillespie
    Faculty of Science and Engineering, Manchester Metropolitan University, John Dalton Building, Chester Street, Manchester, M1 5GD, UK.
  • Neil D Reeves
    Faculty of Science and Engineering, Manchester Metropolitan University, John Dalton Building, Chester Street, Manchester, M1 5GD, UK.
  • Joseph M Pappachan
    Lancashire Teaching Hospitals, Chorley, UK.
  • Claire O'Shea
    Waikato Diabetes Health Board, Hamilton, New Zealand.
  • Eibe Frank
    Department of Computer Science, University of Waikato, Hamilton, New Zealand.