Democratized image analytics by visual programming through integration of deep models and small-scale machine learning.

Journal: Nature communications
PMID:

Abstract

Analysis of biomedical images requires computational expertize that are uncommon among biomedical scientists. Deep learning approaches for image analysis provide an opportunity to develop user-friendly tools for exploratory data analysis. Here, we use the visual programming toolbox Orange ( http://orange.biolab.si ) to simplify image analysis by integrating deep-learning embedding, machine learning procedures, and data visualization. Orange supports the construction of data analysis workflows by assembling components for data preprocessing, visualization, and modeling. We equipped Orange with components that use pre-trained deep convolutional networks to profile images with vectors of features. These vectors are used in image clustering and classification in a framework that enables mining of image sets for both novel and experienced users. We demonstrate the utility of the tool in image analysis of progenitor cells in mouse bone healing, identification of developmental competence in mouse oocytes, subcellular protein localization in yeast, and developmental morphology of social amoebae.

Authors

  • Primož Godec
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Matjaž Pančur
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Nejc Ilenič
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Andrej Čopar
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Martin Stražar
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Aleš Erjavec
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Ajda Pretnar
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Janez Demšar
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Anže Starič
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Marko Toplak
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Lan Žagar
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Jan Hartman
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Hamilton Wang
    Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, TX, 77030, USA.
  • Riccardo Bellazzi
    Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy.
  • Uroš Petrovič
    Biotechnical Faculty, University of Ljubljana, 1000, Ljubljana, Slovenia.
  • Silvia Garagna
    Department of Biology and Biotechnology, University of Pavia, 27100, Pavia, Italy.
  • Maurizio Zuccotti
    Department of Biology and Biotechnology, University of Pavia, 27100, Pavia, Italy.
  • Dongsu Park
    Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, TX, 77030, USA.
  • Gad Shaulsky
    Department of Molecular and Human Genetics, Baylor College of Medicine, Houston, TX, 77030, USA.
  • Blaž Zupan
    Faculty of Computer and Information Science, University of Ljubljana, 1000, Ljubljana, Slovenia. blaz.zupan@fri.uni-lj.si.