A Discrete-Time Neurodynamic Approach to Sparsity-Constrained Nonnegative Matrix Factorization.

Journal: Neural computation
Published Date:

Abstract

Sparsity is a desirable property in many nonnegative matrix factorization (NMF) applications. Although some level of sparseness of NMF solutions can be achieved by using regularization, the resulting sparsity depends highly on the regularization parameter to be valued in an ad hoc way. In this letter we formulate sparse NMF as a mixed-integer optimization problem with sparsity as binary constraints. A discrete-time projection neural network is developed for solving the formulated problem. Sufficient conditions for its stability and convergence are analytically characterized by using Lyapunov's method. Experimental results on sparse feature extraction are discussed to substantiate the superiority of this approach to extracting highly sparse features.

Authors

  • Xinqi Li
    Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong, and Shenzhen Research Institute, City University of Hong Kong, Shenzhen, China xinqi.li@my.cityu.edu.hk.
  • Jun Wang
    Department of Speech, Language, and Hearing Sciences and the Department of Neurology, The University of Texas at Austin, Austin, TX 78712, USA.
  • Sam Kwong