Artificial intelligence-based dairy cattle behavior recognition for estrus detection via ensemble fusion of two camera views.

Journal: PloS one
Published Date:

Abstract

Monitoring cattle behavior plays an important role in improving farm productivity, maintaining animal welfare, and supporting efficient management practices. This study presents a multi-view behavior recognition system that uses synchronized top-view and front-view CCTV footage, combined with deep learning techniques. The system includes four main components: cow identification, behavior classification, identity-behavior association using Intersection-over-Union (IoU), and a decision-level ensemble to combine information from both views. YOLOv8 models are applied separately to each camera angle to detect individual cows and classify six key behaviors: drinking, eating, standing, lying, riding, and chin resting, with the latter two being relevant for estrus detection. The system matches cow identities to their behaviors within each view and then integrates the results to produce a final activity label for each cow.

Authors

  • Panawit Hanpinitsak
    Department of Computer Engineering, Faculty of Engineering, Khon Kaen University, Khon Kaen, Thailand. [email protected].
  • Tatpong Katanyukul
    Department of Computer Engineering, Faculty of Engineering, Khon Kaen University, Khon Kaen, Thailand.
  • Norrawit Tonmitr
    Department of Electrical Engineering, Faculty of Engineering, Khon Kaen University, Khon Kaen, Thailand.
  • Chanon Suntra
    Department of Animal Science, Faculty of Agriculture, Khon Kaen University, Khon Kaen, Thailand.
  • Sora-At Tanusilp
    Department of Electrical Engineering, Faculty of Engineering, Khon Kaen University, Khon Kaen, Thailand.
  • Arthit Phuphaphud
    Department of Agricultural Engineering, Faculty of Engineering, Khon Kaen University, Khon Kaen, Thailand.