A universal network strategy for lightspeed computation of entropy-regularized optimal transport.

Journal: Neural networks : the official journal of the International Neural Network Society
PMID:

Abstract

Optimal transport (OT) is an effective tool for measuring discrepancies in probability distributions and histograms of features. To reduce its high computational complexity, entropy-regularized OT is proposed, which is computed through Sinkhorn algorithm and can be readily integrated into neural networks. However, each time the parameters of networks are updated, both the value and derivative of OT need to be calculated. When there is a relatively high demand for solving accuracy, the number of layers in the computation graph for Sinkhorn algorithm is fairly large, requiring plenty of time and memory. To address this problem, we propose a novel network strategy to estimate the transport matrix instead of Sinkhorn algorithm, which significantly reduces the computation graph size. Compared with other neural OT, our method is suitable for arbitrary cost functions and varying marginal distributions. To avoid numerical instability induced by a small regularization coefficient, we devise the new method in log domain with the dual form. We estimate the error bound of the resulting algorithm for approximate inputs in theory, and extend our approach to robust OT and barycenter computation in practice. Extensive experiments show that our method outperforms baselines on both required computation cost and accuracy significantly.

Authors

  • Yong Shi
    Research Center on Fictitious Economy and Data Science, Chinese Academy of Sciences, Beijing 100190, China; Key Laboratory of Big Data Mining and Knowledge Management, Chinese Academy of Sciences, Beijing 100190, China; College of Information Science and Technology, University of Nebraska at Omaha, Omaha, NE 68182, USA. Electronic address: yshi@ucas.ac.cn.
  • Lei Zheng
    Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin's Clinical Research Center for Cancer, Huanhuxi Road, Hexi District, Tianjin 300060, China.
  • Pei Quan
    School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, 101408, China; Key Laboratory of Big Data Mining and Knowledge Management, Chinese Academy of Sciences, Beijing, 100190, China; Research Center on Fictitious Economy and Data Science, Chinese Academy of Sciences, Beijing, 100190, China. Electronic address: quanpei17@mails.ucas.ac.cn.
  • Yang Xiao
  • Lingfeng Niu
    School of Economics and Management, University of Chinese Academy of Sciences, Beijing, 100190, China. Electronic address: niulf@ucas.ac.cn.