NASA’s new dark energy space telescope can also detect killer asteroids
technologyreview.com·3h ago
Cloud & Infrastructure
The New Stack·Jun 26·5 min read
AWS, Microsoft and Google agree the session is the new unit of compute. They disagree on how to isolate it.
TL;DR
Cloud computing traditionally relied on request-level load balancing, which limited efficiency. AWS, Microsoft, Google, and Anthropic have shifted to session-aware execution, isolating each session for better resource management.
✦ Why It Matters
Engineers can leverage session-aware execution to improve application performance and security in cloud environments.
Key Takeaways
- Adopt session-aware execution for better resource management.
- Implement per-session isolation to enhance security.
- Utilize microVMs for efficient session handling.
- Explore virtualized session models for improved performance.
Full Summary
Cloud computing has typically used a request-level load balancing model, which can lead to inefficiencies when managing multiple user sessions. Recently, major players like AWS, Microsoft, Google, and Anthropic have introduced updates that focus on session-aware execution, where each user session is treated as a distinct unit.
Microsoft revamped its Foundry-hosted agents to support per-session isolation, while Anthropic's Managed Agents utilize a virtualized session model with a harness and sandbox. AWS employs microVMs to route each session, and Google isolates agent code execution in dedicated sandboxes.
This architectural shift allows for improved resource allocation and security, as each session operates independently. The implications for engineers include enhanced performance and the ability to manage resources more effectively in cloud environments.