AI-Based Service Design: 1. Designing with ML and LLM Thinking
We begin a lecture series on designing and building AI-based services.
In this first session, we briefly examine the differences between traditional machine learning (ML) and modern large language models (LLMs), and explore the mindset for designing and approaching services in an LLM-driven paradigm.
00:00 Intro
00:03 Overview of AI Services
00:15 ML vs LLM
00:37 The Core Idea Behind Attention
03:00 How to Understand Problems with LLMs
03:45 Example — Thinking About an E-commerce Recommendation System
04:28 The “Decoder-Does-It-All” View vs When to Use ML