Evaluating crowdsourcing for ICU EEG annotation: A comparison with expert performance.

Journal: Epilepsia
Published Date: Aug 6, 2025

Abstract

OBJECTIVE: Detection of seizures and rhythmic or periodic patterns (SRPPs) on electroencephalography (EEG) is crucial for the diagnosis and management of patients with neurological critical illness. Although automated detection methods are advancing, they require large, high-quality, expert-annotated datasets for training. However, expert annotation is limited by the availability of trained neurophysiologists. Crowdsourcing, or soliciting contributions from a large group of people, may present a potential solution. This study evaluates the feasibility of crowdsourcing annotations of short epochs of EEG recordings by comparing the performance of experts and non-experts in identifying six SRPPs.

Authors

  • Wan-Yee Kong
    Department of Neurology, Beth Israel Deaconess Medical Center, Boston, MA, United States.
  • Fábio A Nascimento
    Department of Neurology, Massachusetts General Hospital, Boston, Massachusetts.
  • Aaron Struck
    University of Wisconsin Hospital and Clinics, Madison, Wisconsin, USA.
  • Erik Duhaime
    Centaur Labs, Boston, USA.
  • Srishti Kapur
    Centaur Labs, Boston, Massachusetts, USA.
  • Edilberto Amorim
    Department of Neurology, Massachusetts General Hospital, Boston, MA, USA; Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA. Electronic address: edilbertoamorim@gmail.com.
  • Gregory Kapinos
    Icahn School of Medicine at Mount Sinai, New York City, New York, USA.
  • Andrés Rodríguez
    Universidad Nacional de Colombia, Medellín, Colombia.
  • Brendan Thomas
    Massachusetts General Hospital, Boston, Massachusetts, USA.
  • Masoom Desai
    University of new Mexico, Albuquerque, New Mexico, USA.
  • Jong Woo Lee
    Department of Neurology, Brigham and Women's Hospital, Boston, MA, USA.
  • M Brandon Westover
    Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts.
  • Jin Jing
    Department of Neurology, Massachusetts General Hospital, Boston, MA, USA.

Keywords

No keywords available for this article.

External Resources

Popular Topics
Recent Journals