Recursive Deep Prior Video: A super resolution algorithm for time-lapse microscopy of organ-on-chip experiments.

Journal: Medical image analysis
Published Date:

Abstract

Biological experiments based on organ-on-chips (OOCs) exploit light Time-Lapse Microscopy (TLM) for a direct observation of cell movement that is an observable signature of underlying biological processes. A high spatial resolution is essential to capture cell dynamics and interactions from recorded experiments by TLM. Unfortunately, due to physical and cost limitations, acquiring high resolution videos is not always possible. To overcome the problem, we present here a new deep learning-based algorithm that extends the well-known Deep Image Prior (DIP) to TLM Video Super Resolution without requiring any training. The proposed Recursive Deep Prior Video method introduces some novelties. The weights of the DIP network architecture are initialized for each of the frames according to a new recursive updating rule combined with an efficient early stopping criterion. Moreover, the DIP loss function is penalized by two different Total Variation-based terms. The method has been validated on synthetic, i.e., artificially generated, as well as real videos from OOC experiments related to tumor-immune interaction. The achieved results are compared with several state-of-the-art trained deep learning Super Resolution algorithms showing outstanding performances.

Authors

  • Pasquale Cascarano
    Department of Mathematics, University of Bologna, Piazza di Porta S. Donato 5, Bologna 40126, Italy.
  • Maria Colomba Comes
    Laboratorio di Biostatistica e Bioinformatica, Fisica Sanitaria, I.R.C.C.S. Istituto Tumori "Giovanni Paolo II", Bari, Italy.
  • Arianna Mencattini
    Department of Electronic Engineering, University of Rome Tor Vergata, 00133, Rome, Italy.
  • Maria Carla Parrini
    Institute Curie, Centre de Recherche, Paris Sciences et Lettres Research University, Paris 75005, France.
  • Elena Loli Piccolomini
    Department of Computer Science and Engineering, Mura Anteo Zamboni 7, Bologna 40126, Italy.
  • Eugenio Martinelli
    Department of Electronic Engineering, University of Rome Tor Vergata, 00133, Rome, Italy.