Llama3 via Groq API | Super Fast Inference | LangChain | Chainlit
In this video, I will show you how to use Llama3 via Gorqchat as well as playground and also demonstrate how you can create a simple ChatGPT like UI locally in your computer. You can follow along with me by cloning the repo locally. The idea is once you know this approach, you can quickly switch different models.
Open Source in Action 🚀
Llama3 as Large Language model.
LangChain is used as a Framework for LLM
Groq to load the LLM
Chainlit is used for deploying.
👉🏼 Links:
Chainlit: https://docs.chainlit.io/get-started/...
LangChain: https://www.langchain.com/
Groq :https://wow.groq.com/
Gorq playground: https://console.groq.com/playground
💻 GitHub repo for code: https://github.com/sudarshan-koirala/...
------------------------------------------------------------------------------------------
☕ Buy me a Coffee: https://ko-fi.com/datasciencebasics
✌️Patreon: / datasciencebasics
------------------------------------------------------------------------------------------
🤝 Connect with me:
📺 Youtube: / @datasciencebasics
👔 LinkedIn: / sudarshan-koirala
🐦 Twitter: / mesudarshan
🔉Medium: / sudarshan-koirala
💼 Consulting: https://topmate.io/sudarshan_koirala
#langchain #chainlit #groq #llama3 #chatui #chatgpt #datasciencebasics