Prototype-based models in machine learning.

Journal: Wiley interdisciplinary reviews. Cognitive science
Published Date:

Abstract

An overview is given of prototype-based models in machine learning. In this framework, observations, i.e., data, are stored in terms of typical representatives. Together with a suitable measure of similarity, the systems can be employed in the context of unsupervised and supervised analysis of potentially high-dimensional, complex datasets. We discuss basic schemes of competitive vector quantization as well as the so-called neural gas approach and Kohonen's topology-preserving self-organizing map. Supervised learning in prototype systems is exemplified in terms of learning vector quantization. Most frequently, the familiar Euclidean distance serves as a dissimilarity measure. We present extensions of the framework to nonstandard measures and give an introduction to the use of adaptive distances in relevance learning.

Authors

  • Michael Biehl
    Bernoulli Institute for Mathematics, Computer Science and Artificial Intelligence, University of Groningen, Groningen, the Netherlands; SMQB, Institute of Metabolism and Systems Research, College of Medical and Dental Sciences, University of Birmingham, Birmingham, United Kingdom.
  • Barbara Hammer
    Librarian at Medical Library, University of Bergen, Bergen 5020, Norway.
  • Thomas Villmann
    Department of Mathematics, University of Applied Sciences Mittweida, Mittweida, Germany.