HomLLM: Exploiting Semantic Homology Relationship for Fine-Grained Bird Image Classification via Large Language Models.

Journal: IEEE transactions on neural networks and learning systems
Published Date: Mar 1, 2026

Abstract

How to recognize endangered bird species in complex outdoor environments has attracted considerable attention in the fields of computer vision and machine learning. However, fine-grained bird image classification (FBIC) is susceptible to problems such as arbitrary postures, interclass discriminability, and occlusions. We propose a novel semantic homology relationship representation learning for fine-grained bird classification with large language models, namely HomLLM, to address these challenges in FBIC effectively. Our proposed model aims to learn homology relationship representations adaptively by identifying invariant structural correspondences between visual features and semantic descriptions, using limited bird data and base class labels. Our approach yields two key findings: 1) invariant homology in key regions of birds that maintain structural consistency across different postures and 2) homological relationship that establish essential taxonomic markers among similar bird classes. Based on these insights, we propose two new modules of the model: the semantic homology generation (SHG) module and homology relationship mining (HRM) module. Specifically, in SHG, bird features are described at multiple granularities through a large language model (LLM) to establish semantic homology. In HRM, feature adaptation is performed separately for textual and visual information, and cross-modal homological interaction is performed hierarchically. In addition, we propose a hierarchical homology interaction scheme to integrate multilevel homological features while preserving structural consistency. Experiments on the commonly used bird datasets CUB-200-2011 and NABirds demonstrate that HomLLM exhibits better performance than state-of-the-art (SOTA) methods.

Authors

  • Hai Liu
    Department of Ophthalmology, The Affiliated Hospital of Yunnan University, Second People's Hospital of Yunnan Province, The Eye Hospital of Yunnan Province, The Eye Disease Clinical Medical Research Center of Yunnan Province, The Eye Disease Clinical Medical Center of Yunnan Province, Kunming, China.
  • Yu Song
    Department of Systems Management, Fukuoka Institute of Technology, Fukuoka, Japan.
  • Tingting Liu
    Center for Drug Safety Evaluation and Research, Shanghai Institute of Materia Medica, Chinese Academy of Sciences, Shanghai, 201203, China.
  • Hao Zheng
    Gilead Sciences, Inc, Foster City, California, USA.
  • Lin Chen
    College of Sports, Nanjing Tech University, Nanjing, China.
  • Zhaoli Zhang
  • You-Fu Li

Keywords

No keywords available for this article.

External Resources

Popular Topics
Recent Journals