The Application of an Intelligent -Harvesting Device Based on FES-YOLOv5s.
Journal:
Sensors (Basel, Switzerland)
PMID:
39860890
Abstract
To address several challenges, including low efficiency, significant damage, and high costs, associated with the manual harvesting of , in this study, a machine vision-based intelligent harvesting device was designed according to its agronomic characteristics and morphological features. This device mainly comprised a frame, camera, truss-type robotic arm, flexible manipulator, and control system. The FES-YOLOv5s deep learning target detection model was used to accurately identify and locate . The harvesting control system, using a Jetson Orin Nano as the main controller, adopted an S-curve acceleration and deceleration motor control algorithm. This algorithm controlled the robotic arm and the flexible manipulator to harvest based on the identification and positioning results. To confirm the impact of vibration on the harvesting process, a stepper motor drive test was conducted using both trapezoidal and S-curve acceleration and deceleration motor control algorithms. The test results showed that the S-curve acceleration and deceleration motor control algorithm exhibited excellent performance in vibration reduction and repeat positioning accuracy. The recognition efficiency and harvesting effectiveness of the intelligent harvesting device were tested using recognition accuracy, harvesting success rate, and damage rate as evaluation metrics. The results showed that the recognition algorithm achieved an average recognition accuracy of 96.72%, with an average missed detection rate of 2.13% and a false detection rate of 1.72%. The harvesting success rate of the intelligent harvesting device was 94.95%, with an average damage rate of 2.67% and an average harvesting yield rate of 87.38%. These results meet the requirements for the intelligent harvesting of and provide insight into the development of intelligent harvesting robots in the industrial production of .