Multi-modal wound classification using wound image and location by deep neural network.

Journal: Scientific reports
Published Date:

Abstract

Wound classification is an essential step of wound diagnosis. An efficient classifier can assist wound specialists in classifying wound types with less financial and time costs and help them decide on an optimal treatment procedure. This study developed a deep neural network-based multi-modal classifier using wound images and their corresponding locations to categorize them into multiple classes, including diabetic, pressure, surgical, and venous ulcers. A body map was also developed to prepare the location data, which can help wound specialists tag wound locations more efficiently. Three datasets containing images and their corresponding location information were designed with the help of wound specialists. The multi-modal network was developed by concatenating the image-based and location-based classifier outputs with other modifications. The maximum accuracy on mixed-class classifications (containing background and normal skin) varies from 82.48 to 100% in different experiments. The maximum accuracy on wound-class classifications (containing only diabetic, pressure, surgical, and venous) varies from 72.95 to 97.12% in various experiments. The proposed multi-modal network also showed a significant improvement in results from the previous works of literature.

Authors

  • D M Anisuzzaman
    Big Data Analytics and Visualization Laboratory, Department of Computer Science, University of Wisconsin-Milwaukee, Milwaukee, WI, USA.
  • Yash Patel
    Department of Computer Science, University of Wisconsin-Milwaukee, Milwaukee, WI, USA.
  • Behrouz Rostami
    Department of Cardiovascular Medicine, Mayo Clinic, Rochester, Minnesota, USA.
  • Jeffrey Niezgoda
    Advancing the Zenith of Healthcare (AZH) Wound and Vascular Center, Milwaukee, WI, USA.
  • Sandeep Gopalakrishnan
    College of Nursing, University of Wisconsin Milwaukee, Milwaukee, WI, 53211, USA. sandeep@uwm.edu.
  • Zeyun Yu
    Big Data Analytics and Visualization Laboratory, Department of Computer Science, University of Wisconsin-Milwaukee, Milwaukee, WI, USA. yuz@uwm.edu.