Towards Scale and Position Invariant Task Classification using Normalised Visual Scanpaths in Clinical Fetal Ultrasound.

Journal: Simplifying medical ultrasound : second international workshop, ASMUS 2021 : held in conjunction with MICCAI 2021, Strasbourg, France, September 27, 2021 : proceedings. ASMUS (Workshop) (2nd : 2021 : Online)
Published Date:

Abstract

We present a method for classifying tasks in fetal ultrasound scans using the eye-tracking data of sonographers. The visual attention of a sonographer captured by eye-tracking data over time is defined by a scanpath. In routine fetal ultrasound, the captured standard imaging planes are visually inconsistent due to fetal position, movements, and sonographer scanning experience. To address this challenge, we propose a scale and position invariant task classification method using normalised visual scanpaths. We describe a normalisation method that uses bounding boxes to provide the gaze with a reference to the position and scale of the imaging plane and use the normalised scanpath sequences to train machine learning models for discriminating between ultrasound tasks. We compare the proposed method to existing work considering raw eyetracking data. The best performing model achieves the F1-score of 84% and outperforms existing models.

Authors

  • Clare Teng
    Institute of Biomedical Engineering, University of Oxford, Oxford, UK.
  • Harshita Sharma
    Institute of Biomedical Engineering, University of Oxford, Oxford, UK.
  • Lior Drukker
    Nuffield Department of Women's & Reproductive Health, University of Oxford, Oxford, UK.
  • Aris T Papageorghiou
    Nuffield Department of Women's & Reproductive Health, University of Oxford, Oxford, OX3 9DU, UK.
  • J Alison Noble
    Institute of Biomedical Engineering, University of Oxford, Oxford, UK.

Keywords

No keywords available for this article.