Third-party cyber evaluations involving OpenAI models
openai.com·13h ago
Cloud & Infrastructure
The New Stack·28d ago·5 min read
Coinbase runs 1,200 agents and just slashed its AI bill in half
TL;DR
Coinbase has optimized its AI operations by implementing a system that utilizes 1,200 agents to route tasks across multiple AI models. This strategic shift has allowed the company to reduce its AI expenses by 50%.
✦ Why It Matters
Consider implementing a multi-model AI strategy to reduce costs and improve performance in your projects.
Key Takeaways
- Adopt a multi-model approach to AI workloads.
- Default to lower-cost models for routine tasks.
- Implement aggressive caching to improve efficiency.
- Continuously evaluate model performance against your specific workloads.
How It Works
Coinbase's infrastructure uses an internal LLM gateway to automatically route tasks to the most appropriate AI model based on cost, complexity, and cache state. This dynamic decision-making process allows for significant cost savings while maintaining performance.