TL;DR
Obtaining detailed annotations for ecological data is challenging, hindering machine learning applications. A multi-scale weakly supervised semantic segmentation (WSSS) framework was developed to train segmentation models using classification outputs from drone imagery.
✦ Why It Matters
Engineers can leverage this framework to efficiently map ecological habitats without extensive annotation efforts.
Key Takeaways
Full Summary
In ecological research, acquiring pixel-level annotations for large areas is often impractical, limiting the use of machine learning techniques. A novel multi-scale weakly supervised semantic segmentation (WSSS) framework was created to address this issue, allowing for the training of high-resolution segmentation models from dense classification outputs.
The approach integrates fine-scale, multi-label predictions from underwater images with broad aerial data, converting point-level classifications into coarse supervision masks for training on Unmanned Aerial Vehicle (UAV) orthophotos. A second training phase refines the model's predictions to enhance spatial accuracy without additional annotations.
Tested on coral reef imagery, the model achieved 86.07% pixel accuracy and 52.23% mean Intersection over Union (mIoU) on manually annotated zones. This framework demonstrates the potential for effective large-scale ecological monitoring and can adapt to include new classes, making it a versatile tool for researchers.
Related