Distillation-Enabled Knowledge Alignment Protocol for Semantic Communication in AI Agent Networks
Journal:
arXiv
Published Date:
May 7, 2025
Abstract
Future networks are envisioned to connect massive artificial intelligence
(AI) agents, enabling their extensive collaboration on diverse tasks. Compared
to traditional entities, these agents naturally suit the semantic communication
(SC), which can significantly enhance the bandwidth efficiency. Nevertheless,
SC requires the knowledge among agents to be aligned, while agents have
distinct expert knowledge for their individual tasks in practice. In this
paper, we propose a distillation-enabled knowledge alignment protocol (DeKAP),
which distills the expert knowledge of each agent into parameter-efficient
low-rank matrices, allocates them across the network, and allows agents to
simultaneously maintain aligned knowledge for multiple tasks. We formulate the
joint minimization of alignment loss, communication overhead, and storage cost
as a large-scale integer linear programming problem and develop a highly
efficient greedy algorithm. From computer simulation, the DeKAP establishes
knowledge alignment with the lowest communication and computation resources
compared to conventional approaches.