Reinforcement Learning With LLMs Interaction For Distributed Diffusion Model Services.

Journal: IEEE transactions on pattern analysis and machine intelligence
Published Date:

Abstract

Distributed Artificial Intelligence-Generated Content (AIGC) has attracted significant attention, but two key challenges remain: maximizing subjective Quality of Experience (QoE) and improving energy efficiency, which are particularly pronounced in widely adopted Generative Diffusion Model (GDM)-based image generation services. In this paper, we propose a novel user-centric Interactive AI (IAI) approach for service management, with a distributed GDM-based AIGC framework that emphasizes efficient and cooperative deployment. The proposed method restructures the GDM inference process by allowing users with semantically similar prompts to share parts of the denoising chain. Furthermore, to maximize the users' subjective QoE, we propose an IAI approach, i.e., Reinforcement Learning With Large Language Models Interaction (RLLI), which utilizes Large Language Model (LLM)-empowered generative agents to replicate users interactions, providing real-time and subjective QoE feedback aligned with diverse user personalities. Lastly, we present the GDM-based Deep Deterministic Policy Gradient (G-DDPG) algorithm, adapted to the proposed RLLI framework, to allocate communication and computing resources effectively while accounting for subjective user traits and dynamic wireless conditions. Simulation results demonstrate that G-DDPG improves total QoE by $15\%$ compared with the standard DDPG algorithm.

Authors

  • Hongyang Du
    Heze Administrative Approval Guarantee Center, 3443 Huanghe East Road, Heze City, 274000, Shandong Province, China.
  • Ruichen Zhang
  • Dusit Niyato
    School of Computer Science and Engineering, Nanyang Technological University, Singapore, Singapore.
  • Jiawen Kang
  • Zehui Xiong
    Pillar of Information Systems Technology and Design, Singapore University of Technology and Design, Singapore, Singapore.
  • Shuguang Cui
  • Xuemin Shen
    Department of Oral Mucosal Diseases, Shanghai Ninth People's Hospital, College of Stomatology, Shanghai Jiao Tong University School of Medicine, Shanghai, China.
  • Dong In Kim
    Division of Life Sciences, Incheon National University, Incheon, 22012, South Korea.

Keywords

No keywords available for this article.