Determined AI + HuggingFace!
This video will present the Determined AI Model Hub for using HuggingFace transformers, tokenizers, and datasets with the Determined training platform! I hope you find this video useful!
Overview of Determined on Henry AI Labs:
• Presenting... Determined AI!
Challenges of Advanced Hyperparameter Search on Henry AI Labs:
• Challenges of Advanced AutoML - Determined AI
Walkthrough of the Determined CIFAR-10 Example on Henry AI Labs:
• Determined AI Example - CIFAR-10 Hyperpara...
Determined Transformers Examples: https://docs.determined.ai/latest/mod...
HuggingFace Models: https://huggingface.co/models
HuggingFace Datasets: https://huggingface.co/datasets/swag
ASHA Blog Post: https://blog.ml.cmu.edu/2018/12/12/ma...
HF v4.8: / 1408081750379671554
Thanks for watching! Please Subscribe!
Chapters
0:00 Introduction
1:38 HuggingFace Models and Datasets
2:58 Determined Training Platform
5:14 Cluster Resource Allocation
5:46 ASHA Quick Recap
7:00 LR Search Visualization
9:32 Configuration Code
11:02 HuggingFace Dataset Integration
12:04 MLM Training
12:49 Save the Model