Key learnings from putting LLMs into production (keynote by idealo's ML Engineer Christopher Lennan)
In this keynote from the applydata summit 2024, Christopher Lennan, Machine Learning Engineering Lead at idealo.de, shared key learnings from idealo’s journey of moving GenAI solutions beyond the prototype phase. He is discussing the strategy for identifying high-impact GenAI/LLM use cases, the importance of structured outputs, and advanced prompt engineering techniques.
✦ Learn more about us: https://applydata.io/
✦ Stay connected and follow our latest insights on LinkedIn: / applydata-by-diconium
00:00 Intro
00:17 Introduction of Christopher Lennan, Machine Learning Engineering Lead at idealo.de
02:00 The status of GenAI & LLMs
04:00 LLM learning: focus on user needs & LLM strengths
10:23 LLM learning: using LLMs as a language interface rather than knowledge base
16:20 LLM learning: the importance of LLM evaluation for scaling
17:50 Can LLM-as-a-judge work?
19:35 Q&A about key learnings from putting LLMs into production
#machinelearning #llm #llms #ai #aikeynote #llmusecase