FedPPD: Towards effective subgraph federated learning via pseudo prototype distillation.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Subgraph federated learning (subgraph-FL) is a distributed machine learning paradigm enabling cross-client collaborative training of graph neural networks (GNNs). However, real-world subgraph-FL scenarios often face subgraph heterogeneity problem, i.e., variations in nodes and topology across multiple subgraphs. As a result, the global model experiences a decline in performance. Despite several well-designed methods being proposed, most still rely on parameter aggregation-based global GNN for inference, which oversimplifies the subgraph knowledge and leads to sub-optimal performance. To this end, we propose achieving effective subgraph federated learning via pseudo prototype distillation (FedPPD). Specifically, FedPPD first utilizes a generator under the guidance of local prototypes to explore the global input space. Subsequently, the generated pseudo graph is used for distilling knowledge from the local GNNs to the vanilla-aggregated global GNN to convey reliable knowledge oversimplified during aggregation. Extensive experimental validation on six public datasets demonstrates that FedPPD consistently outperforms state-of-the-art baselines. Our code is available at https://github.com/KyrieLQ/FedPPD.

Authors

  • Qi Lin
    Shandong University, School of Mechanical, Electrical and Information Engineering, Weihai, 264209, China. Electronic address: 202100800115@mail.sdu.edu.cn.
  • Jishuo Jia
    Shandong University, School of Mechanical, Electrical and Information Engineering, Weihai, 264209, China. Electronic address: jiajishuo@mail.sdu.edu.cn.
  • Yinlin Zhu
    Sun Yat-sen University, School of Computer Science and Engineering, Guangzhou, 510275, China.
  • Xunkai Li
    Beijing Institute of Technology, School of Computer Science and Technology, Beijing, 100081, China.
  • Bin Jiang
    Department of Urology, Chinese People's Liberation Army General Hospital, Beijing, 100039 China.
  • Meixia Qu
    Shandong University, School of Mechanical, Electrical and Information Engineering, Weihai, 264209, China.

Keywords

No keywords available for this article.