We’re launching Lyria 3.5 in Google Flow Music, with advances across musicality, lyrics, vocals, and creative control
deepmind.google·6d ago
AI Engineering
VS Code Blog·5 min read
Introducing auto model selection (preview)
TL;DR
Developers using VS Code faced slow response times and rate limiting when calling AI models for code assistance. VS Code introduced auto model selection, a feature that automatically routes requests to the fastest available model based on current conditions.
✦ Why It Matters
Engineers can now get faster AI code suggestions with fewer interruptions and lower costs without manual configuration.
Key Takeaways
- Utilize auto model selection for optimal AI performance.
- Take advantage of the 10% discount on premium requests.
- Monitor model selection and multipliers in chat responses.
- Provide feedback via VS Code Insiders to improve features.
How It Works
Auto model selection evaluates the current capacity and performance of available models, automatically choosing the most suitable one for each request. It uses a variable model multiplier to adjust the cost of requests based on the selected model, ensuring users receive the best service while managing system load.