Flexible unsupervised feature extraction for image classification.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Dimensionality reduction is one of the fundamental and important topics in the fields of pattern recognition and machine learning. However, most existing dimensionality reduction methods aim to seek a projection matrix W such that the projection Wx is exactly equal to the true low-dimensional representation. In practice, this constraint is too rigid to well capture the geometric structure of data. To tackle this problem, we relax this constraint but use an elastic one on the projection with the aim to reveal the geometric structure of data. Based on this context, we propose an unsupervised dimensionality reduction model named flexible unsupervised feature extraction (FUFE) for image classification. Moreover, we theoretically prove that PCA and LPP, which are two of the most representative unsupervised dimensionality reduction models, are special cases of FUFE, and propose a non-iterative algorithm to solve it. Experiments on five real-world image databases show the effectiveness of the proposed model.

Authors

  • Yang Liu
    Department of Computer Science, Hong Kong Baptist University, Hong Kong, China.
  • Feiping Nie
    School of Computer Science and Center for OPTical IMagery Analysis and Learning (OPTIMAL), Northwestern Polytechnical University, Xi'an 710072, Shaanxi, PR China.
  • Quanxue Gao
    State Key Laboratory, Integrated Services Networks, Xidian University, 710071, Xi'an, China. Electronic address: qxgao@xidian.edu.cn.
  • Xinbo Gao
  • Jungong Han
    School of Computing and Communications, Lancaster University, United Kingdom.
  • Ling Shao