Agentic data science with the Data Agent Kit
cloud.google.com·7h ago
Data Science
Simon Willison's Blog·14d ago·5 min read
llm-anthropic 0.30
TL;DR
The llm-anthropic 0.30 release introduces the ability to refresh the list of Anthropic models via their API and includes a token counting feature. This allows developers to access new models without needing a software update and estimate token usage before sending prompts.
✦ Why It Matters
Integrate the new token counting feature today to optimize your prompt costs and manage your budget effectively.
Key Takeaways
- Utilize the new API to refresh model lists dynamically.
- Estimate token usage before sending prompts to control costs.
- Prepare for budget caps by monitoring token consumption.
- Stay updated with new model releases without software updates.
Full Summary
The llm-anthropic 0.30 update enhances the functionality of the Claude Sonnet 5.5 model by enabling direct interaction with the Anthropic API. This means developers can refresh the list of available models without waiting for a new software release, streamlining the integration of newly released models.
Additionally, a new command leverages Anthropic's free token counting API, allowing users to estimate the number of tokens a prompt will consume before submission. This feature is crucial for managing costs, especially as budget caps are anticipated to be necessary by October 2026.
The update reflects a growing trend in AI development towards more dynamic and cost-effective model management.