TL;DR
Strawberry-harvesting robots struggle with issues like poor visual perception and gripper misalignment, leading to inefficiencies. A visual fault diagnosis and self-recovery framework called SRR-Net was developed, which integrates detection, segmentation, and ripeness assessment of both fruit and gripper.
✦ Why It Matters
Engineers can leverage the SRR-Net framework to enhance the efficiency of robotic harvesting systems in agriculture.
Key Takeaways
How It Works
The framework employs an end-to-end model, SRR-Net, which integrates multiple tasks such as detection and segmentation of strawberries and gripper alignment. A micro-optical camera captures real-time images, allowing the MobileNet V3-Small classifier to adjust the gripper's position dynamically.
During the harvesting process, an LSTM classifier predicts potential slippage, enabling the robot to take corrective actions like re-inflation or aborting the cycle.
Related