Fully Complex-Valued Dendritic Neuron Model.

Journal: IEEE transactions on neural networks and learning systems
Published Date:

Abstract

A single dendritic neuron model (DNM) that owns the nonlinear information processing ability of dendrites has been widely used for classification and prediction. Complex-valued neural networks that consist of a number of multiple/deep-layer McCulloch-Pitts neurons have achieved great successes so far since neural computing was utilized for signal processing. Yet no complex value representations appear in single neuron architectures. In this article, we first extend DNM from a real-value domain to a complex-valued one. Performance of complex-valued DNM (CDNM) is evaluated through a complex XOR problem, a non-minimum phase equalization problem, and a real-world wind prediction task. Also, a comparative analysis on a set of elementary transcendental functions as an activation function is implemented and preparatory experiments are carried out for determining hyperparameters. The experimental results indicate that the proposed CDNM significantly outperforms real-valued DNM, complex-valued multi-layer perceptron, and other complex-valued neuron models.

Authors

  • Shangce Gao
    Department of Intellectual Information Engineering, Faculty of Engineering, University of Toyama, No. 5506, Information Technology Building (G9), Gofuku 3190, Toyama 930-8555, Japan.
  • MengChu Zhou
  • Ziqian Wang
  • Daiki Sugiyama
  • Jiujun Cheng
  • Jiahai Wang
  • Yuki Todo
    School of Electrical and Computer Engineering, Kanazawa University, Kanazawa-shi 920-1192, Japan.