TL;DR
BACAM introduces a novel approach to continual agent merging that integrates new expert behaviors without losing previously learned interactions. It achieves a 62.82% success rate across various tasks, outperforming existing methods significantly.
✦ Why It Matters
Consider implementing BACAM for your multi-turn interaction systems to enhance performance without sacrificing existing capabilities.
Key Takeaways
How It Works
BACAM learns parameter-wise merging gates from interaction trajectories generated by experts. This allows the model to selectively integrate new expert behaviors while preserving previously learned interactions.
The method employs task-level stability-plasticity control to manage the balance between retaining old knowledge and acquiring new skills, alongside tensor-level conflict-aware updates to prevent interference during the merging process.
Related