Agentic data science with the Data Agent Kit
cloud.google.com·7h ago
AI Research
arXiv CS.AI·Jul 23·5 min read
Beyond Fail-to-Pass: Iterative Hardening of Co-Generated Bug Reproduction Tests and Fixes
TL;DR
CoHarden is a new framework that enhances bug reproduction tests (BRTs) for automated program repair by iteratively refining tests and fixes. It significantly improves repair success rates, achieving 69.4% resolved cases and 78.9% fail-to-pass accuracy on benchmark tests.
✦ Why It Matters
Implement CoHarden's iterative approach to improve your automated bug repair processes today.
Key Takeaways
- Adopt CoHarden for improved bug reproduction and repair.
- Focus on rigorous BRTs to avoid incorrect patches.
- Utilize iterative refinement in test generation.
- Evaluate BRTs beyond fail-to-pass criteria.
How It Works
CoHarden begins by generating a bug reproduction test (BRT) from a bug report. It then iteratively refines both the test and the corresponding fix by applying mutation patches, ensuring that the test does not allow for lax regressions.
This process enhances the reliability of the generated tests and fixes, leading to higher success rates in automated program repair.