Fine-Tune Llama3 using Synthetic Data
how to fine tune Llama-3 model in Google Colab in this tutorial using synthetically generated data. In this video chris not only shows you how to fine tune the model but also shows you his lessons learned, such as diversity of data, why the system prompt makes a difference, generalization and fine tuning to a particular format.
You will not only learn how to fine tune a model but also how to generate synthetic data, and learn what works and what doesn't.
Google Colab
https://colab.research.google.com/dri...
GIthub for Dataset:
https://github.com/chrishayuk/chuk-da...
HuggingFace for Model
https://huggingface.co/chrishayuk/lla...
HuggingFace for DataSet
https://huggingface.co/datasets/chris...