Discriminative clustering via extreme learning machine.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Discriminative clustering is an unsupervised learning framework which introduces the discriminative learning rule of supervised classification into clustering. The underlying assumption is that a good partition (clustering) of the data should yield high discrimination, namely, the partitioned data can be easily classified by some classification algorithms. In this paper, we propose three discriminative clustering approaches based on Extreme Learning Machine (ELM). The first algorithm iteratively trains weighted ELM (W-ELM) classifier to gradually maximize the data discrimination. The second and third methods are both built on Fisher's Linear Discriminant Analysis (LDA); but one approach adopts alternative optimization, while the other leverages kernel k-means. We show that the proposed algorithms can be easily implemented, and yield competitive clustering accuracy on real world data sets compared to state-of-the-art clustering methods.

Authors

  • Gao Huang
    Department of Automation, Tsinghua University, Beijing 100084, China. huang-g09@mails.tsinghua.edu.cn
  • Tianchi Liu
    School of Electrical and Electronic Engineering, Nanyang Technological University, Nanyang Avenue, 639798, Singapore. Electronic address: tcliu@ntu.edu.sg.
  • Yan Yang
    Department of Endocrinology and Metabolism, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.
  • Zhiping Lin
    School of Electrical and Electronic Engineering, Nanyang Technological University, Nanyang Avenue, 639798, Singapore. Electronic address: ezplin@ntu.edu.sg.
  • Shiji Song
  • Cheng Wu
    Department of Automation, Tsinghua University, Beijing 100084, China. Electronic address: wuc@tsinghua.edu.cn.