HANDS ON SESSION ON USING DATA-PREP-KIT FOR FINE TUNING LLMS
In the next section of this tutorial series, we will guide the participants on how to build data pipelines from scratch using the transforms discussed in the above section using data-prep-kit, an open-source library. The participants will then use this library to set up and run individual transforms on their laptops and analyse the results on sample datasets. Post running the individual transforms, the participants will be able to build a data pipeline by stitching the transforms together and using the filtering component to remove ``bad" data identified by each data transform module. At the end of this session, a participant will be equipped to build their own data processing pipelines to get the data ready for fine tuning their LLMs. This will offer an end-to-end experience that users can then apply to their own projects.