Tensor ring rank determination using odd-dimensional unfolding.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

While tensor ring (TR) decomposition methods have been extensively studied, the determination of TR-ranks remains a challenging problem, with existing methods being typically sensitive to the determination of the starting rank (i.e., the first rank to be optimized). Moreover, current methods often fail to adaptively determine TR-ranks in the presence of noisy and incomplete data, and exhibit computational inefficiencies when handling high-dimensional data. To address these issues, we propose an odd-dimensional unfolding method for the effective determination of TR-ranks. This is achieved by leveraging the symmetry of the TR model and the bound rank relationship in TR decomposition. In addition, we employ the singular value thresholding algorithm to facilitate the adaptive determination of TR-ranks and use randomized sketching techniques to enhance the efficiency and scalability of the method. Extensive experimental results in rank identification, data denoising, and completion demonstrate the potential of our method for a broad range of applications.

Authors

  • Yichun Qiu
    School of Automation, Guangdong University of Technology, Guangzhou 510006, China; Center for Advanced Intelligence Project (AIP), RIKEN, Tokyo 103-0027, Japan. Electronic address: ycqiu@gdut.edu.cn.
  • Guoxu Zhou
  • Chao Li
    McGill University Health Centre, McGill Adult Unit for Congenital Heart Disease Excellence, Montreal, Québec, Canada.
  • Danilo Mandic
    Department of Electrical and Electronic Engineering, Imperial College London, London, United Kingdom. Electronic address: d.mandic@imperial.ac.uk.
  • Qibin Zhao
    RIKEN Center for Advanced Intelligence Project (AIP), 103-0027, Japan.