GuidedStyle: Attribute knowledge guided style manipulation for semantic face editing.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Although significant progress has been made in synthesizing high-quality and visually realistic face images by unconditional Generative Adversarial Networks (GANs), there is still a lack of control over the generation process in order to achieve semantic face editing. In this paper, we propose a novel learning framework, called GuidedStyle, to achieve semantic face editing on pretrained StyleGAN by guiding the image generation process with a knowledge network. Furthermore, we allow an attention mechanism in StyleGAN generator to adaptively select a single layer for style manipulation. As a result, our method is able to perform disentangled and controllable edits along various attributes, including smiling, eyeglasses, gender, mustache, hair color and attractive. Both qualitative and quantitative results demonstrate the superiority of our method over other competing methods for semantic face editing. Moreover, we show that our model can be also applied to different types of real and artistic face editing, demonstrating strong generalization ability.

Authors

  • Xianxu Hou
  • Xiaokang Zhang
    Computer Vision Institute, College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China; Shenzhen Institute of Artificial Intelligence and Robotics for Society, Shenzhen, China; Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen University, Shenzhen, China.
  • Hanbang Liang
    Computer Vision Institute, College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, Guangdong, 518060, China; AI Research Center for Medical Image Analysis and Diagnosis, Shenzhen University, Shenzhen 518060, China; Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen University, Shenzhen 518060, China.
  • Linlin Shen
  • Zhihui Lai
    College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, 518055, Guangdong, China.
  • Jun Wan
    Department of Medical and Molecular Genetics, Collaborative Core for Cancer Bioinformatics, Indianapolis, IN.