GPT OSS Release, Inference and Fine tuning
📜Get repo access at https://Trelis.com/ADVANCED-fine-tuning
🗝️ Get Trelis Multi-Repo Bundle (https://Trelis.com/multi-repo-bundle)
Access all SEVEN Trelis Github Repos (-robotics, -vision, -evals, -fine-tuning, -inference, -voice, -time-series)
Support via Github Issues & Trelis’ Private Discord
Tip: If you subscribe here on YouTube, click the bell to be notified of new vids
🛠️ (NEW) Trelis Fine-tuning Workshops: https://trelis.com/workshops-and-semi...
💡 Need Technical or Market Assistance?
Book a Consult Here: https://forms.gle/wJXVZXwioKMktjyVA
🤝 Are You a Top Developer?
Work for Trelis: https://trelis.com/jobs/
💸 Starting a New Project/Venture?
Apply for a Trelis Grant: https://trelis.com/trelis-ai-grants/
📧 Get Trelis AI Tutorials by Email
Subscribe on Substack: https://trelis.substack.com
Video Links:
OpenAI Blog: https://openai.com/index/introducing-...
HuggingFace Model: https://huggingface.co/openai/gpt-oss...
BASIC-fine-tuning repo: https://github.com/TrelisResearch/BAS...
MX FP4: https://chatgpt.com/share/68936c44-7f...
TIMESTAMPS:
00:00 Introduction to OpenAI's OSS Models
00:16 Model Specifications and Performance
02:36 Quantization and Mixture of Experts
04:00 MXFP8 Data Type
08:46 Running Inference on OSS Models
13:01 Fine-Tuning GPT OSS Models with transformers
24:43 Exploring Track IO Feature
26:33 ADVANCED fine-tuning tricks
27:37 Using TensorBoard for Logging
29:03 Creating a Validation Split
30:12 Inspecting the Chat Template
31:30 Preparing the Model for Training
31:47 Training Parameters and Debugging
46:41 Connecting to the Pod via SSH to git commit
49:06 Final Thoughts on OpenAI OSS Models
49:52 BONUS: Insights on Proprietary Models