How ChatGPT is Trained - model and training explained
This video is gives an overview of the ChatGPT model and its training procedure. This is the first video in a series videos about ChatGPT. Future videos include limitations and future enhancements to ChatGPT, tools similar to ChatGPT for other AI applications. So, please stay tuned.
⌚️ ⌚️ ⌚️ TIMESTAMPS ⌚️ ⌚️ ⌚️
0:00 - Intro
00:50 - Limitations of GPT models and Alignment
02.28 - Example ChatGPT response
02:55 - Reinforcement Learning
04:28 - Reinforcement Learning from Human Feedback
05:40 - ChatGPT Model overview
06:27 - ChatGPT Model Training Step 1
07:35 - ChatGPT Model Training Step 2
09:50 - ChatGPT Model Training Step 3
🧸 🧸 🧸 TOYS OF THE TRADE 🧸 🧸 🧸
📝 XP-Pen for my scribbles - https://amzn.to/3HNOpPH
⌨️🐭 My Keyboard & Mouse - https://amzn.to/3XKZ3wF
🖥 My Monitor - https://amzn.to/3YdVpvT
💻 My GPUs - https://amzn.to/3YE2aXX
🎤 My Mic - https://amzn.to/3YCdDHA
My work desk - https://amzn.to/3GWF1IP
🛠 🛠 🛠 MY SOFTWARE TOOLS 🛠 🛠 🛠
✍️ Notion - https://affiliate.notion.so/aibites-yt
📹 OBS Studio for video editing - https://obsproject.com
📼 Manim for some animations - https://www.manim.community
🎵 My music - https://www.bensound.com
📚 📚 📚 BOOKS I HAVE READ, REFER AND RECOMMEND 📚 📚 📚
📖 Deep Learning by Ian Goodfellow - https://amzn.to/3Wnyixv
📙 Pattern Recognition and Machine Learning by Christopher M. Bishop - https://amzn.to/3ZVnQQA
📗 Machine Learning: A Probabilistic Perspective by Kevin Murphy - https://amzn.to/3kAqThb
📘 Multiple View Geometry in Computer Vision by R Hartley and A Zisserman - https://amzn.to/3XKVOWi
#chatgpt #deeplearning #transformers #aibites #machinelearning