SIM-ELM: Connecting the ELM model with similarity-function learning.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

This paper moves from the affinities between two well-known learning schemes that apply randomization in the training process, namely, Extreme Learning Machines (ELMs) and the learning framework using similarity functions. These paradigms share a common approach involving data remapping and linear separators, but differ in the role of randomization within the respective learning algorithms. The paper presents an integrated approach connecting the two models, which ultimately yields a new variant of the basic ELM. The resulting learning scheme is characterized by an analytical relationship between the dimensionality of the remapped space and the learning abilities of the eventual predictor. Experimental results confirm that the new learning scheme can improve over conventional ELM in terms of the trade-off between classification accuracy and predictor complexity (i.e., the dimensionality of the remapped space).

Authors

  • Paolo Gastaldo
    Department of Electrical, Electronics, and Telecommunications Engineering and Naval Architecture (DITEN), University of Genoa, Genova, Italy. Electronic address: paolo.gastaldo@unige.it.
  • Federica Bisio
    Department of Electrical, Electronics, and Telecommunications Engineering and Naval Architecture (DITEN), University of Genoa, Genova, Italy. Electronic address: federica.bisio@edu.unige.it.
  • Sergio Decherchi
    1] CONCEPT Lab, Istituto Italiano di Tecnologia, via Morego 30, 16163 Genova, Italy [2] BiKi Technologies s.r.l., via XX Settembre 33, 16121 Genova, Italy.
  • Rodolfo Zunino
    Department of Electrical, Electronics, and Telecommunications Engineering and Naval Architecture (DITEN), University of Genoa, Genova, Italy. Electronic address: rodolfo.zunino@unige.it.