AI Nerds for Commerce #2 - Evals with Michal Przadka (How do I know my AI works?)
In this conversation, Artur Wala and Michal Przadka discuss the significance of evaluation (eval) processes in AI development.
They discuss how the true competitive advantage in AI lies not in the models themselves but in the ability to effectively evaluate and improve them.
Chapters
00:00 Understanding AI Evaluation Metrics
08:34 The Importance of Custom Evaluation Frameworks
12:57 Starting Small with AI Evaluations
20:40 Building Internal Expertise for AI Success
25:52 The Future of AI and Continuous Improvement
AI, evals, customer support, performance metrics, AI development, business strategy, model evaluation, AI systems