Analysis and Design of Multivalued High-Capacity Associative Memories Based on Delayed Recurrent Neural Networks.

Journal: IEEE transactions on cybernetics
Published Date:

Abstract

This article aims at analyzing and designing the multivalued high-capacity-associative memories based on recurrent neural networks with both asynchronous and distributed delays. In order to increase storage capacities, multivalued activation functions are introduced into associative memories. The stored patterns are retrieved by external input vectors instead of initial conditions, which can guarantee accurate associative memories by avoiding spurious equilibrium points. Some sufficient conditions are proposed to ensure the existence, uniqueness, and global exponential stability of the equilibrium point of neural networks with mixed delays. For neural networks with n neurons, m -dimensional input vectors, and 2k -valued activation functions, the autoassociative memories have (2k) storage capacities and heteroassociative memories have min {(2k),(2k)} storage capacities. That is, the storage capacities of designed associative memories in this article are obviously higher than the 2 and min {2,2} storage capacities of the conventional ones. Three examples are given to support the theoretical results.

Authors

  • Jiahui Zhang
    Department of Critical Care Medicine, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China.
  • Song Zhu
    College of Sciences, China University of Mining and Technology, Xuzhou, 221116, China. Electronic address: songzhu82@gmail.com.
  • Gang Bao
    Hubei Key Laboratory of Cascaded Hydropower Stations Operation & Control, Electrical Engineering & New Energy, China Three Gorges University, Yichang 443002, China. Electronic address: ctgugangbao@ctgu.edu.cn.
  • Xiaoyang Liu
    School of Computer Science & Technology, Jiangsu Normal University, Xuzhou 221116, China. Electronic address: liuxiaoyang1979@gmail.com.
  • Shiping Wen