EmbeddingGemma 2: an open, lightweight multimodal embedding model
deepmind.google·6d ago
AI Engineering
Lobsters·Aug 5·5 min read
How Compiler Explorer Runs on AWS in 2026
TL;DR
Compiler Explorer has evolved significantly since 2016, now utilizing AWS services like CloudFront and Terraform for efficient operation. This update details the architecture and services that support compile requests.
✦ Why It Matters
Explore the open-source infrastructure repository to understand and potentially contribute to Compiler Explorer's architecture.
Key Takeaways
- Utilize EC2 spot instances for significant cost savings.
- Implement content-addressed storage to improve data access speed.
- Leverage auto-scaling groups for efficient resource management.
- Maintain legacy versions of tools to prevent link rot.
How It Works
Compiler Explorer uses a combination of AWS services to manage compilation requests efficiently. Requests are routed through CloudFront to a load balancer, which directs them to specific clusters based on the requested compiler.
The use of auto-scaling groups ensures that resources are allocated dynamically based on demand, while spot instances reduce costs significantly. CEFS optimizes storage by allowing on-demand mounting of content-addressed images, improving boot times and reducing latency.