Deep learning for detection and segmentation of artefact and disease instances in gastrointestinal endoscopy.

Journal: Medical image analysis
Published Date:

Abstract

The Endoscopy Computer Vision Challenge (EndoCV) is a crowd-sourcing initiative to address eminent problems in developing reliable computer aided detection and diagnosis endoscopy systems and suggest a pathway for clinical translation of technologies. Whilst endoscopy is a widely used diagnostic and treatment tool for hollow-organs, there are several core challenges often faced by endoscopists, mainly: 1) presence of multi-class artefacts that hinder their visual interpretation, and 2) difficulty in identifying subtle precancerous precursors and cancer abnormalities. Artefacts often affect the robustness of deep learning methods applied to the gastrointestinal tract organs as they can be confused with tissue of interest. EndoCV2020 challenges are designed to address research questions in these remits. In this paper, we present a summary of methods developed by the top 17 teams and provide an objective comparison of state-of-the-art methods and methods designed by the participants for two sub-challenges: i) artefact detection and segmentation (EAD2020), and ii) disease detection and segmentation (EDD2020). Multi-center, multi-organ, multi-class, and multi-modal clinical endoscopy datasets were compiled for both EAD2020 and EDD2020 sub-challenges. The out-of-sample generalization ability of detection algorithms was also evaluated. Whilst most teams focused on accuracy improvements, only a few methods hold credibility for clinical usability. The best performing teams provided solutions to tackle class imbalance, and variabilities in size, origin, modality and occurrences by exploring data augmentation, data fusion, and optimal class thresholding techniques.

Authors

  • Sharib Ali
    Institute of Biomedical Engineering, Big Data Institute, Department of Engineering Science, University of Oxford, Oxford, UK. sharib.ali@eng.ox.ac.uk.
  • Mariia Dmitrieva
    Department of Engineering Science, University of Oxford, Oxford, United Kingdom.
  • Noha Ghatwary
    University of Lincoln, Lincoln, UK. nghatwary@lincoln.ac.uk.
  • Sophia Bano
    Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS) and Department of Computer Science, University College London, London, UK. sophia.bano@ucl.ac.uk.
  • Gorkem Polat
    Graduate School of Informatics, Middle East Technical University, Ankara, Turkey.
  • Alptekin Temizel
    Graduate School of Informatics, Middle East Technical University, Ankara, Turkey.
  • Adrian Krenzer
    Department of Artificial Intelligence and Knowledge Systems, University of Würzburg, Germany.
  • Amar Hekalo
    Department of Artificial Intelligence and Knowledge Systems, University of Würzburg, Germany.
  • Yun Bo Guo
    School of Engineering, University of Central Lancashire, UK.
  • Bogdan Matuszewski
    School of Engineering, University of Central Lancashire, UK.
  • Mourad Gridach
    High Institute of Technology, Ibn Zohr University, Agadir, Morocco. Electronic address: m.gridach@uiz.ac.ma.
  • Irina Voiculescu
    Department of Computer Science, University of Oxford, UK.
  • Vishnusai Yoganand
    Mimyk Medical Simulations Pvt Ltd, Indian Institute of Science, Bengaluru, India.
  • Arnav Chavan
    Indian Institute of Technology (ISM), Dhanbad, India.
  • Aryan Raj
    Indian Institute of Technology (ISM), Dhanbad, India.
  • Nhan T Nguyen
    Medical Imaging Department, Vingroup Big Data Institute (VinBDI), Hanoi, Vietnam.
  • Dat Q Tran
    Medical Imaging Department, Vingroup Big Data Institute (VinBDI), Hanoi, Vietnam.
  • Le Duy Huynh
    EPITA Research and Development Laboratory (LRDE), F-94270 Le Kremlin-Bicêtre, France.
  • Nicolas Boutry
    EPITA Research and Development Laboratory (LRDE), F-94270 Le Kremlin-Bicêtre, France.
  • Shahadate Rezvy
    School of Science and Technology, Middlesex University London, UK.
  • Haijian Chen
    Department of Computer Science, School of Informatics, Xiamen University, China.
  • Yoon Ho Choi
    Samsung Advanced Institute for Health Sciences & Technology (SAIHST), Sungkyunkwan University, Seoul, Republic of Korea.
  • Anand Subramanian
    Claritrics India Pvt Ltd, Chennai, India.
  • Velmurugan Balasubramanian
    School of Medical Science and Technology, Indian Institute of Technology, Kharagpur, West Bengal, India.
  • Xiaohong W Gao
    Department of Computer Science , Middlesex University , London NW4 4BT , U.K.
  • Hongyu Hu
    Shanghai Jiaotong University, Shanghai, China.
  • Yusheng Liao
    State Key Laboratory of Chemo and Biosensing College of Chemistry and Chemical Engineering, Hunan University, Changsha 410082, P. R. China.
  • Danail Stoyanov
    University College London, London, UK.
  • Christian Daul
    CRAN UMR 7039, University of Lorraine, CNRS, Nancy, France.
  • Stefano Realdon
    Instituto Onclologico Veneto, IOV-IRCCS, Padova, Italy.
  • Renato Cannizzaro
    CRO Centro Riferimento Oncologico IRCCS, Aviano, Italy.
  • Dominique Lamarque
    Université de Versailles St-Quentin en Yvelines, Hôpital Ambroise Paré, France.
  • Terry Tran-Nguyen
    Translational Gastroenterology Unit, Experimental Medicine Div., John Radcliffe Hospital, University of Oxford, Oxford, UK.
  • Adam Bailey
    Translational Gastroenterology Unit, Nuffield Department of Medicine, Experimental Medicine Div., John Radcliffe Hospital, University of Oxford, Oxford, UK.
  • Barbara Braden
    Translational Gastroenterology Unit, Nuffield Department of Medicine, Experimental Medicine Div., John Radcliffe Hospital, University of Oxford, Oxford, UK.
  • James E East
    Translational Gastroenterology Unit, Nuffield Department of Medicine, Experimental Medicine Div., John Radcliffe Hospital, University of Oxford, Oxford, UK.
  • Jens Rittscher
    Department of Engineering Science, University of Oxford, Oxford, United Kingdom.