AWS launches new AI-powered EC2 instances
Developers can migrate their existing ML models to the new instances with minimal changes, AWS says
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
Amazon’scloud computingdivision, Amazon Web Services(AWS), has launched a new class of Elastic Compute Cloud(EC2)instances designed exclusively for training machine learning (ML) models.
Known as DL1, the new EC2 instances are powered byGaudi acceleratorsfromIntel-owned Habana Labs, and according to AWS provide up to 40% better price performance for training ML models as compared to the existingGPU-powered EC2 instances.
“The addition of DL1 instances featuring Gaudi accelerators provides the most cost-effective alternative toGPU-based instancesin the cloud to date. Their optimal combination of price and performance makes it possible for customers to reduce the cost to train, train more models, and innovate faster,”observedDavid Brown, Vice President, of Amazon EC2, at AWS.
Democratizing AI
AWS suggests the new DL1 instances lend themselves to popular ML use cases including natural language processing(NLP), object detection and classification, fraud detection, recommendation and personalization engines, intelligent document processing, business forecasting, and more.
Customers can consume DL1 instances with up to eight Gaudi accelerators, 256 GB of high-bandwidth memory, 768 GB of system memory, 2nd generation Amazon customIntel Xeon Scalable(Cascade Lake) processors, 400 Gbps of networking throughput, and up to 4 TB of localNVMe storage.
To help customers get started with the new instances, AWS offers the Habana SynapseAI SDK, which is integrated with popular ML frameworks including TensorFlow and PyTorch.
AWS reasons this will help customers migrate their existing ML models from GPU-based or CPU-based instances onto DL1 instances, with minimal code changes. Furthermore, developers and data scientists can get started using the various reference models optimized for Gaudi accelerators in Habana’s GitHub repository.
Are you a pro? Subscribe to our newsletter
Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed!
DL1 instances are available on demand via a low-cost pay-as-you-go usage model with no upfront commitments.
With almost two decades of writing and reporting on Linux, Mayank Sharma would like everyone to think he’sTechRadar Pro’sexpert on the topic. Of course, he’s just as interested in other computing topics, particularly cybersecurity, cloud, containers, and coding.
Don’t search for information on cats at work — you could be at risk of being hacked
Key Strategies for financial institutions to combat fraud
Nvidia’s GeForce Now Priority membership has upgraded to ‘Performance’ - introducing a 1440p resolution and ultrawide support
