DiverseReID: Towards generalizable person re-identification via Dynamic Style Hallucination and decoupled domain experts.

Journal: Neural networks : the official journal of the International Neural Network Society
Published Date:

Abstract

Person re-identification (re-ID) models often fail to generalize well when deployed to other camera networks with domain shift. A classical domain generalization (DG) solution is to enhance the diversity of source data so that a model can learn more domain-invariant, and hence generalizable representations. Existing methods typically mix images from different domains in a mini-batch to generate novel styles, but the mixing coefficient sampled from predefined Beta distribution requires careful manual tuning and may render sub-optimal performance. To this end, we propose a plug-and-play Dynamic Style Hallucination (DSH) module that adaptively adjusts the mixing weights based on the style distribution discrepancy between image pairs, which is dynamically measured with the reciprocal of Wasserstein distances. This approach not only reduces the tedious manual tuning of parameters but also significantly enriches style diversity by expanding the perturbation space to the utmost. In addition, to promote inter-domain diversity, we devise a Domain Experts Decoupling (DED) loss, which constrains features from one domain to go towards the orthogonal direction against features from other domains. The proposed approach, dubbed DiverseReID, is parameter-free and computationally efficient. Without bells and whistles, it outperforms the state-of-the-art on various DG re-ID benchmarks. Experiments verify that style diversity, not just the size of the training data, is crucial for enhancing generalization.

Authors

  • Jieru Jia
    Institute of Big Data Science and Industry, Shanxi University, Taiyuan 030006, China; School of Computer and Information Technology, Shanxi University, Taiyuan, China; Engineering Research Center for Machine Vision and Data Mining of Shanxi Province, Shanxi University, Taiyuan 030006, China. Electronic address: jierujia@sxu.edu.cn.
  • Huidi Xie
    Institute of Big Data Science and Industry, Shanxi University, Taiyuan 030006, China; School of Computer and Information Technology, Shanxi University, Taiyuan, China; Engineering Research Center for Machine Vision and Data Mining of Shanxi Province, Shanxi University, Taiyuan 030006, China.
  • Qin Huang
    Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, China.
  • Yantao Song
    Institute of Big Data Science and Industry, Shanxi University, Taiyuan 030006, China.
  • Peng Wu
    Department of Orthopedics, General Hospital of Ningxia Medical University, Yinchuan, China.