Third-party cyber evaluations involving OpenAI models
openai.com·14h ago
Cloud & Infrastructure
AWS Blog·Jun 18·5 min read
AWS Blog·Jun 18·5 min readAnnouncing Amazon EC2 G7 instances accelerated by NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs
TL;DR
High-performance GPU acceleration was needed for AI inference and data analytics workloads. Amazon EC2 G7 instances were launched, utilizing NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs.
✦ Why It Matters
Engineers can leverage G7 instances for significantly improved performance in AI and graphics workloads.
Key Takeaways
- Leverage G7 instances for improved AI inference and graphics performance.
- Utilize high bandwidth networking for low-latency applications.
- Explore multiple instance sizes to match your workload needs.
- Access G7 instances in US East and US West regions now.
Full Summary
Amazon EC2 G7 instances are now available, featuring NVIDIA RTX PRO 4500 Blackwell Server Edition GPUs, which enhance performance for AI inference, graphics rendering, and data analytics. These instances utilize custom sixth-generation Intel Xeon Scalable processors, achieving up to 4.6 times the AI inference performance and 2.1 times the graphics performance of the previous G6 instances.
Key improvements include faster GPU memory with 32 GB per GPU and high bandwidth networking of 700 Gbps, which is seven times faster than G6. G7 instances support a variety of workloads, including video transcoding and virtual desktop infrastructure.
They are available in multiple sizes, supporting up to 8 GPUs and 256 GB of GPU memory, making them suitable for demanding applications. Users can start utilizing these instances in US East and US West regions with various purchasing options.