NASA’s new dark energy space telescope can also detect killer asteroids
technologyreview.com·2h ago
Data Science
Simon Willison's Blog·May 15·3 min read
datasette-llm-limits 0.1a0
TL;DR
Large language model (LLM) usage in Datasette—a data exploration tool—lacked spending controls, allowing unbounded API costs. Simon Willison created datasette-llm-limits, a plugin enabling per-user or global spending caps on LLM queries.
✦ Why It Matters
Teams deploying Datasette with LLM features can now control costs and prevent unexpected API bills through simple configuration.
Key Takeaways
- Set daily spending limits for LLM usage in Datasette.
- Configure limits on a per-user or global basis.
- Use a rolling 24-hour window for limit tracking.
- Prevent unexpected charges by managing AI service costs.
How It Works
The plugin integrates with existing Datasette tools, allowing users to define spending limits through a simple configuration syntax. Users can specify limits in terms of a rolling 24-hour window, ensuring that they can monitor and control their usage effectively.