I Created An LLM Model In Google Colab!
Created An LLM Model In Google Colab!
Colab link to the Mighty BartPhi-1.0: https://colab.research.google.com/dri...
Am I the first person to build an LLM model in Google Colab? Introducing, BartPhi-1.0! It currently utilizes Bart as the initial input layer, and then feeds that output to Phi-1.5. Phi-1.5 then outputs worse and less coherent text than it otherwise would as a result!
It's a start though. I proved it can be done. No GPU. Now to play around with fine tuning BartPhi and different configurations to turn it into something that is actually useful!