Running a Large Language Model on our HPC systems
Large Language Models are all the hype but how can you set one up? Here I walk through installing Databricks' Dolly v2.0 LLM on UCL's Myriad HPC cluster and interacting with it.
Code: https://github.com/owainkenwayucl/LLM...
Dolly v2.0: https://www.databricks.com/blog/2023/...
Dolly on Github: https://github.com/databrickslabs/dolly
Dolly on 🤗: https://huggingface.co/databricks/dol...