Get started with HuggingFace Transformers - Pipeline, Custom Pipeline, Tokenizer, Model, Hub
The Transformers architecture is fundamental to almost all the Large Language Models (LLMs) out there like Chat-GPT, LLAMA, Vicuna and you name it. The transformers is the main building block of these models.
If you want to get hands-on and train or fine-tune LLMs you cannot escape working with the Transformers Python library from HuggingFace.
So In this video, I will walk you through the Transformers library so that you can get up to speed working with it.
⌚️ ⌚️ ⌚️ TIMESTAMPS ⌚️ ⌚️ ⌚️
0:00 - Intro
1:05 - Installation
1:25 - Pipeline
3:46 - Create Custom Pipeline
5:59 - AutoClass
8:28 - Tokenizer
11:30 - Model
13:39 - Saving the Model
14:55 - HuggingFace Hub
15:22 - Extro
RELATED LINKS
Notebook for this video: https://github.com/ai-bites/generativ...
HuggingFace Transformers: https://huggingface.co/docs/transform...
Transformers github repo: https://github.com/huggingface/transf...
MY KEY LINKS
YouTube: / @aibites
Twitter: / ai_bites
Patreon: / ai_bites
Github: https://github.com/ai-bites
#machinelearning #deeplearning #aibites