Principal Component Analysis based on Nuclear norm Minimization.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Principal component analysis (PCA) is a widely used tool for dimensionality reduction and feature extraction in the field of computer vision. Traditional PCA is sensitive to outliers which are common in empirical applications. Therefore, in recent years, massive efforts have been made to improve the robustness of PCA. However, many emerging PCA variants developed in the direction have some weaknesses. First, few of them pay attention to the 2D structure of error matrix. Second, to estimate data mean from sample set with outliers by averaging is usually biased. Third, if some elements of a sample are disturbed, to extract principal components (PCs) by directly projecting data with transformation matrix causes incorrect mapping of sample to its genuine location in low-dimensional feature subspace. To alleviate these problems, we present a novel robust method, called nuclear norm-based on PCA (N-PCA) to take full advantage of the structure information of error image. Meanwhile, it is developed under a novel unified framework of PCA to remedy the bias of computing data mean and the low-dimensional representation of a sample both of which are treated as unknown variables in a single model together with projection matrix. To solve N-PCA, we propose an iterative algorithm, which has a closed-form solution in each iteration. Experimental results on several open databases demonstrate the effectiveness of the proposed method.

Authors

  • Jian-Xun Mi
    Chongqing Key Laboratory of Image cognition, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China. Electronic address: mijianxun@gmail.com.
  • Ya-Nan Zhang
    Chongqing Key Laboratory of Image cognition, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China. Electronic address: zyn962464@gmail.com.
  • Zhihui Lai
    College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, 518055, Guangdong, China.
  • Weisheng Li
    Chongqing Key Laboratory of Image cognition, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China.
  • Lifang Zhou
    Chongqing Key Laboratory of Image cognition, Chongqing University of Posts and Telecommunications, Chongqing 400065, China; College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; College of Software, Chongqing Univ. of Posts and Telecommunications, Chongqing 400065, China.
  • Fujin Zhong
    Chongqing Key Laboratory of Image cognition, Chongqing University of Posts and Telecommunications, Chongqing 400065, China.