Quantization-based chained privacy-preserving federated learning.

Journal: Scientific reports
Published Date:

Abstract

Federated Learning (FL) is an advanced distributed machine learning framework crucial in protecting data privacy and security. By enabling multiple participants to train models while keeping their data local collaboratively, FL effectively mitigates the risks associated with centralized storage and sharing of raw data. However, traditional FL schemes face significant challenges regarding communication efficiency, computational costs, and privacy preservation. For instance, its communication and computational overhead in edge computing scenarios is often excessively high, hindering real-time applications. This paper proposes an innovative federated learning framework, Q-Chain FL, integrating quantization compression techniques into a chained FL architecture. This Q-Chain FL scheme adopts efficient compression and transmission of model parameter differences at the user node and executes seamless decompression and aggregation at the server node. Experiments on several publicly available datasets, including MNIST, CIFAR-10, and CelebA, demonstrate low communication and computational overhead, fast convergence speed, and high security of Q-Chain FL. Compared to traditional FedAvg and Chain-PPFL, Q-Chain FL reduces communication overhead by approximately 62.5% and 44.7%, respectively. These results underscore the robustness and adaptability of Q-Chain FL in various datasets and real-world learning scenarios.

Authors

  • Ya Liu
    Department of Electrical Automation, Hebei University of Water Resources and Electric Engineering, Cangzhou 061001, China.
  • Shumin Wu
    Department of Department of Clinical Pharmacy, Shunde Hospital, Southern Medical University (The First People's Hospital of Shunde), Foshan, Guangdong Province, PR China.
  • Yibo Li
    State Key Laboratory of Natural and Biomimetic Drugs, School of Pharmaceutical Sciences , Peking University , Xueyuan Road 38 , Haidian District, 100191 Beijing , China.
  • Fengyu Zhao
    The Department of Information and Intelligence Engineering, Shanghai Publishing and Printing College, Shanghai, 200093, China.
  • Yanli Ren
    The School of Communication and Information Engineering, Shanghai University, Shanghai, 200444, China.

Keywords

No keywords available for this article.