Dynamic Uncertainty Learning with Noisy Correspondence for Text-Based Person Search
Journal:
arXiv
Published Date:
May 10, 2025
Abstract
Text-to-image person search aims to identify an individual based on a text
description. To reduce data collection costs, large-scale text-image datasets
are created from co-occurrence pairs found online. However, this can introduce
noise, particularly mismatched pairs, which degrade retrieval performance.
Existing methods often focus on negative samples, amplifying this noise. To
address these issues, we propose the Dynamic Uncertainty and Relational
Alignment (DURA) framework, which includes the Key Feature Selector (KFS) and a
new loss function, Dynamic Softmax Hinge Loss (DSH-Loss). KFS captures and
models noise uncertainty, improving retrieval reliability. The bidirectional
evidence from cross-modal similarity is modeled as a Dirichlet distribution,
enhancing adaptability to noisy data. DSH adjusts the difficulty of negative
samples to improve robustness in noisy environments. Our experiments on three
datasets show that the method offers strong noise resistance and improves
retrieval performance in both low- and high-noise scenarios.