Part 2: How to Build an AI Voice Agent using OpenAI Realtime API: RAG + Function Calling
👉 Join my community: https://www.skool.com/become-an-ai-op...
🚀 Sign up to Replit using my link: https://replit.com/refer/bart31
PART 3 OUT NOW: • Part 3: How to Build an AI Voice Agent usi...
Part 2: Upgrading the OpenAI Realtime API Voice Agent
In this tutorial, we enhance our original Voice Agent with:
RAG (Retrieval-Augmented Generation)
Function calling
Caller history
AI answering the phone first
Watch till the end for valuable insights and unique implementation techniques!
📺 Watch Part 1: • Part 1: How to Build an AI Voice Agent usi...
📺 Watch Part 3: • Part 3: How to Build an AI Voice Agent usi...
📺 AI SMS Assistant: • How to Build an Advanced AI SMS Assistant
📋 Take This Quick Survey: https://forms.gle/otAr1xUamgyYZE5y7
🛠️ Need this built? Contact: [email protected]
🗂️ GitHub Repo: https://github.com/Barty-Bart/openai-...
👉 LinkedIn: / bartlomiejslodyczka
Learn AI & Coding:
Try Scrimba's AI Engineer course (20% off Pro plan with my link):
https://v2.scrimba.com/the-ai-enginee...
Other related videos: • Exploring OpenAI's New GPT-4o Audio Previe...
#openai #realtimeapi #maketutorial #replit
Note: Affiliate links support this channel through commissions.
Timestamps
00:00 Realtime API Call Demo
01:08 Overview Of The Build
5:15 Breakdown of Code And Make.com Automation
08:28 How Twilio API Works
13:48 Main Configuration And Function Calls
16:00 (WATCH THIS) How To Make AI Speak First
18:57 Function Call Breakdown
26:35 Setting Up Replit With Our Code
28:45 Testing Replit And Connecting To Twilio
30:25 Deploying Replit
33:05 Outro