Training Transformers with AWS Trainium and the Hugging Face Neuron AMI
In this video, I show you how to accelerate Transformer training with AWS Trainium, a new custom chip designed by AWS, and the brand new Hugging Face Neuron Amazon Machine Image (AMI).
First, I walk you through the setup of an Amazon EC2 trn1.32xlarge instance, equipped with 16 Trainium chips. Then, I run a natural language processing job, accelerating a BERT model to classify the Yelp review datatset on 32 Neuron cores.
⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos ⭐️⭐️⭐️
⭐️⭐️⭐️ Want to buy me a coffee? I can always use more :) https://www.buymeacoffee.com/julsimon ⭐️⭐️⭐️
- Hugging Face Neuron AMI on AWS Marketplace: https://aws.amazon.com/marketplace/pp...
- Original Trainium video with the AWS Deep Learning AMI: • Accelerate Transformer training with ...
- Code: https://gitlab.com/juliensimon/huggin...
- AWS Trainium: https://aws.amazon.com/ec2/instance-t...
- AWS Neuron SDK documentation: https://awsdocs-neuron.readthedocs-ho...
Interested in hardware acceleration? Check out my other videos :
- Habana Gaudi: • Accelerate Transformer training with ...
- Graphcore: • Accelerate Transformer training with ...
- Trainium on SageMaker: • Accelerate Transformers on Amazon Sag...