Which methods are the most effective in enabling novice users to participate in ontology creation? A usability study.

Journal: Database : the journal of biological databases and curation
Published Date:

Abstract

Producing findable, accessible, interoperable and reusable (FAIR) data cannot be accomplished solely by data curators in all disciplines. In biology, we have shown that phenotypic data curation is not only costly, but it is burdened with inter-curator variation. We intend to propose a software platform that would enable all data producers, including authors of scientific publications, to produce ontologized data at the time of publication. Working toward this goal, we need to identify ontology construction methods that are preferred by end users. Here, we employ two usability studies to evaluate effectiveness, efficiency and user satisfaction with a set of four methods that allow an end user to add terms and their relations to an ontology. Thirty-three participants took part in a controlled experiment where they evaluated the four methods (Quick Form, Wizard, WebProtégé and Wikidata) after watching demonstration videos and completing a hands-on task. Another think-aloud study was conducted with three professional botanists. The efficiency effectiveness and user confidence in the methods are clearly revealed through statistical and content analyses of participants' comments. Quick Form, Wizard and WebProtégé offer distinct strengths that would benefit our author-driven FAIR data generation system. Features preferred by the participants will guide the design of future iterations.

Authors

  • Limin Zhang
    School of Information, University of Arizona, 1103 E. Second Street, Tucson, AZ 85705, USA.
  • Xingyi Yang
    School of Information, University of Arizona, 1103 E. Second Street, Tucson, AZ 85705, USA.
  • Zuleima Cota
    School of Information, University of Arizona, 1103 E. Second Street, Tucson, AZ 85705, USA.
  • Hong Cui
    School of Information Resources and Library Science, University of Arizona, Tucson, USA. hongcui@email.arizona.edu.
  • Bruce Ford
    Department of Biological Sciences, University of Manitoba, 50 Sifton Road, Winnipeg, MB R3T 2N2, Canada.
  • Hsin-Liang Chen
    Curtis Laws Wilson Library, Missouri University of Science and Technology, 400 W. 14th Street, Rolla, MO 65409, USA.
  • James A Macklin
    Agriculture Agri-Food Canada, Ottawa, Canada. James.Macklin@agr.gc.ca.
  • Anton Reznicek
    SLA Herbarium, University of Michigan, 3600 Varsity Drive, Ann Arbor, MI 48019, USA.
  • Julian Starr
    Department of Biology, University of Ottawa, 30 Marie Curie Road, Ottawa, ON K1N 6N5, Canada.