In this video, I introduce MPT-7B, the latest development in the MosaicML Foundation Series. It is a commercially-usable, open-source LLM that was trained on 1 trillion tokens of text and code.
Watch as we compare the MPT-7B to popular open-source LLMs like LLaMA series from Meta, the Pythia series from EleutherAI, the StableLM series from StabilityAI, and the OpenLLaMA model from Berkeley AI Research. See how MPT-7B surpasses these models in terms of commercial usability, training volume, input handling, training speed, and inference optimization.
The blog post can be found here:
https://www.mosaicml.com/blog/mpt-7b