fine tuning LLMs - the 6 stages

Опубликовано: 27 Октябрь 2024
на канале: AI Bites
908
40

What does it take to select a pre-trained LLM model, fine-tune it, and deploy it to production? The entire process of fine-tuning can be divided into 6 steps imo.

This video gives an overview of all the six steps involved in the "fine-tuning lifecycle" of a model.

⌚️ ⌚️ ⌚️ TIMESTAMPS ⌚️ ⌚️ ⌚️
0:00 Intro
1:36 - What is finetuning?
3:12 - Step 1 Select a pre-trained model
3:56 - Step 2 Define the task
4:36 - Step 3 Labelling
5:30 - Step 4 Fine-tuning
6:40 - Step 5 Evaluation
7:54 - Step 6 Deployment

MY KEY LINKS
Newsletter: https://www.ai-bites.net
YouTube:    / @aibites  
Twitter:   / ai_bites​  
Patreon:   / ai_bites​  
Github: https://github.com/ai-bites​

WHO AM I?
I am a Machine Learning researcher/practitioner who has seen the grind of academia and start-ups equally. I started my career as a software engineer 15 years ago. Because of my love for Mathematics (coupled with a glimmer of luck), I graduated with a Master's in Computer Vision and Robotics in 2016 when the now happening AI revolution just started. Life has changed for the better ever since.

#machinelearning #deeplearning #aibites