How to run LLM Locally? | Integrate LLM in your APP | Build with LLM | Ollama | Streamlit
In this video we are covering the exciting and constantly growing field of open source LLMs. We have really useful tools that have sprung up like LM studio, Ollama and Auto gen studio that make it easy to run any Open Source LLM locally. Plus they provide us with the option to run the LLMs as an API. Imagine the possibilities with this option. We can integrate these LLMs within our apps or build anything on top of them. Let’s build a chatbot using an Open source LLM.
Like to Code on GitHub: https://github.com/hnawaz007/pythonda...
Link to Ollama : https://ollama.com/
Link to Ollama Python library: https://ollama.com/blog/python-javasc...
#ai #ollama #llm
💥Subscribe to our channel:
/ haqnawaz
📌 Links
-----------------------------------------
#️⃣ Follow me on social media! #️⃣
🔗 GitHub: https://github.com/hnawaz007
📸 Instagram: / bi_insights_inc
📝 LinkedIn: / haq-nawaz
🔗 / hnawaz100
-----------------------------------------
Topics in this video (click to jump around):
==================================
0:00 Introduction LLM Tools
0:38 Ollama Installation & Configuration
1:03 Ollama available LLMs
1:14 Download & Run Models
1:55 Ollama Python library & Code
2:09 Streamlit basic app
2:42 Integrate Local LLM into Streamlit
3:28 Test LLM integration via Chat