Graph Neural Networks With Convolutional ARMA Filters.

Journal: IEEE transactions on pattern analysis and machine intelligence
Published Date:

Abstract

Popular graph neural networks implement convolution operations on graphs based on polynomial spectral filters. In this paper, we propose a novel graph convolutional layer inspired by the auto-regressive moving average (ARMA) filter that, compared to polynomial ones, provides a more flexible frequency response, is more robust to noise, and better captures the global graph structure. We propose a graph neural network implementation of the ARMA filter with a recursive and distributed formulation, obtaining a convolutional layer that is efficient to train, localized in the node space, and can be transferred to new graphs at test time. We perform a spectral analysis to study the filtering effect of the proposed ARMA layer and report experiments on four downstream tasks: semi-supervised node classification, graph signal classification, graph classification, and graph regression. Results show that the proposed ARMA layer brings significant improvements over graph neural networks based on polynomial filters.

Authors

  • Filippo Maria Bianchi
    Department of Information Engineering, Electronics and Telecommunications (DIET), "Sapienza" University of Rome, Via Eudossiana 18, 00184 Rome, Italy. Electronic address: filippomaria.bianchi@uniroma1.it.
  • Daniele Grattarola
    Faculty of Informatics, Università della Svizzera italiana, Lugano, Switzerland.
  • Lorenzo Livi
    Department of Computer Science, College of Engineering, Mathematics and Physical Sciences, University of Exeter, Exeter EX4 4QF, United Kingdom.
  • Cesare Alippi
    Department of Electronics, Information, and Bioengineering, Politecnico di Milano, 20133 Milan, Italy.