Domain randomization-enhanced deep learning models for bird detection.

Journal: Scientific reports
PMID:

Abstract

Automatic bird detection in ornithological analyses is limited by the accuracy of existing models, due to the lack of training data and the difficulties in extracting the fine-grained features required to distinguish bird species. Here we apply the domain randomization strategy to enhance the accuracy of the deep learning models in bird detection. Trained with virtual birds of sufficient variations in different environments, the model tends to focus on the fine-grained features of birds and achieves higher accuracies. Based on the 100 terabytes of 2-month continuous monitoring data of egrets, our results cover the findings using conventional manual observations, e.g., vertical stratification of egrets according to body size, and also open up opportunities of long-term bird surveys requiring intensive monitoring that is impractical using conventional methods, e.g., the weather influences on egrets, and the relationship of the migration schedules between the great egrets and little egrets.

Authors

  • Xin Mao
    Department of Chemistry, College of Sciences, Shanghai University, Shanghai 200444, China.
  • Jun Kang Chow
    Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR, China.
  • Pin Siang Tan
    Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR, China.
  • Kuan-Fu Liu
    Division of Integrative Systems and Design, The Hong Kong University of Science and Technology, Hong Kong, SAR, China.
  • Jimmy Wu
    Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR, China.
  • Zhaoyu Su
    Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR, China.
  • Ye Hur Cheong
    Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR, China.
  • Ghee Leng Ooi
    Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR, China.
  • Chun Chiu Pang
    School of Biological Sciences, The University of Hong Kong, Hong Kong, SAR, China.
  • Yu-Hsing Wang
    Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology, Hong Kong, SAR, China. ceyhwang@ust.hk.