Fine-tuning GPTJ(GPT3) With Docker And WandB Update
In this video, I go over some updates to the fine-tuning repo. Including docker support, wandb support, and other features.
Repo: https://github.com/mallorbc/Finetune_...
Discord: / discord
#gpt3 #chatgpt #gptj #docker #machinelearning #nlp #wandb #ai
Timestamps
00:00 - Intro
00:45 - README Requirements
02:30 - Cloning Repo
03:15 - Looking At Docker Files
06:20 - Running Docker Image
06:40 - DeepSpeed Configs
07:20 - WandB Support
09:12 - Creating A Dataset
09:28 - Training Arguments
10:40 - Fine-tuning A Model
12:23 - WandB Stats
13:24 - Outro