Llama-CPP-Python: Step-by-step Guide to Run LLMs on Local Machine | Llama-2 | Mistral
Hi, My name is Sunny Solanki, and in this video, I provide a step-by-step guide to running Local LLMs using Python library "llama-cpp-python". I have explained how to use llama-2 and mistral models on local machine.
============================================
CODE - https://github.com/sunny2309/llama_cp...
==============================================
=======================================================
SUPPORT US - Buy Me Coffee - https://buymeacoffee.com/coderzcolumn
=======================================================
=======================================================
NEWSLETTER - http://eepurl.com/gRW2u9
=======================================================
=======================================================
WEBSITE - https://coderzcolumn.com
=======================================================
Important Chapters:
0:00 - Llama-CPP-Python
1:19 - Generate Text (Query Response)
4:39 - Stream Response of LLMs
5:40 - Pull Models from HuggingFace
7:26 - Chat Completion
10:01 - Generate Embeddings for RAG Apps
#python #datascience #datasciencetutorial #python #pythonprogramming #pythoncode #pythontutorial #llama2 #llama-cpp-python #llama-cpp #llama-2-7b-chat-gguf #llama-2-7b-chat-locally #llama-2-7b-chat-locally-python #mistral-7b-locally #mistral-7b-locally-python #local-llms