Llama 2 in LangChain — FIRST Open Source Conversational Agent!

Опубликовано: 28 Октябрь 2024
на канале: James Briggs
135,564
2.6k

Llama 2 is the best-performing open-source Large Language Model (LLM) to date. In this video, we discover how to use the 70B parameter model fine-tuned for chat (Llama 2 70B Chat) using Hugging Face transformers and LangChain. We will see how to apply Llama 2 as a conversational agent within LangChain.

📌 Code Notebook
https://github.com/pinecone-io/exampl...

🌲 Subscribe for Latest Articles and Videos:
https://www.pinecone.io/newsletter-si...

👋🏼 AI Consulting:
https://aurelio.ai

👾 Discord:
  / discord  

Twitter:   / jamescalam  
LinkedIn:   / jamescalam  

00:00 Llama 2 Model
02:55 Getting Access to Llama 2
06:12 Initializing Llama 2 70B with Hugging Face
08:17 Quantization and GPU Memory Requirements
11:14 Loading Llama 2
13:05 Stopping Criteria
15:17 Initializing Text Generation Pipeline
16:25 Loading Llama 2 in LangChain
17:08 Creating Llama 2 Conversational Agent
19:46 Prompt Engineering with Llama 2 Chat
22:16 Llama 2 Conversational Agent
24:14 Future of Open Source LLMs

#artificialintelligence #nlp #opensource #huggingface #langchain