Lecture 6: Infrastructure & Tooling (Full Stack Deep Learning - Spring 2021)
In this video, you'll get exposed to the core areas of ML infrastructure and tools landscape. Then, you'll also see a comprehensive overview of tools and platforms for the training/evaluation bucket - which includes software engineering, computing needs, resource management, frameworks and distributed training, experiment management, hyperparameter optimization, and end-to-end solutions.
00:00 - Introduction
00:24 - The Dream vs. The Reality for ML Practitioners
03:18 - The 3 Buckets of ML Infrastructure/Tooling Landscape
06:20 - Software Engineering
17:06 - Compute Hardware
36:55 - Resource Management
41:40 - Frameworks and Distributed Training
52:48 - Experiment Management
55:43 - Hyperparameter Tuning
59:00 - "All-In-One" Solutions
01:06:24 - Follow us on Twitter for #ToolingTuesday! (@full_stack_dl)