NASA’s new dark energy space telescope can also detect killer asteroids
technologyreview.com·1h ago
TL;DR
Software engineers faced challenges in efficiently interacting with large language models (LLMs) for user queries. Simon Willison developed the ask_user() feature using a new LLM alpha model.
✦ Why It Matters
Engineers can implement the ask_user() feature to improve user interaction with LLMs in their applications.
Key Takeaways
How It Works
The ask_user() feature allows tools to pause execution and ask users questions, utilizing a ToolContext object. This interaction is rendered as a form in the chat UI, and the conversation state is saved in the internal database, ensuring continuity even after server restarts.
Related