LLMOps on AWS & Why Data Prep Still Matters
References:
Hugging Face’s story on Amazon EC2 Inf2 Instances: https://aws.amazon.com/ec2/instance-t...
ByteDance saves up to 60% on inference costs while reducing latency and increasing throughput using AWS Inferentia: https://aws.amazon.com/blogs/machine-...
Emad Mostaque full interview on 20VC: • Emad Mostaque: These 5 Companies Will Win ...
Amazon SageMaker Jumpstart
Sections:
0:00 Seeing LLMOps in AWS
0:32 Amazon Chips Stories
1:05 What’s LLMOps?
1:50 Data prep still matters?
2:16 Data prep required?
2:46 Garbage in, Garbage out
3:57 Amazon SageMaker
4:53 Sponsorship
4:56 Context / Embeddings
5:27 Pricing
5:30 Licensing / Open Source
Disclaimer: this is my personal channel and do not reflect the views of any of the companies mentioned.