Determined AI Example - CIFAR-10 Hyperparameter Search!
This tutorial will walkthrough Determined AI's CIFAR-10 example. This will show you the basics of how to define a hyperparameter search configuration and how to integrate that with different data loaders, model definitions, loss functions, callbacks, and so on. From this tutorial you should have a sense of the Determined API and the Experiment Tracking visualization and Hyperparameter search features!
Determined AI Examples: https://github.com/determined-ai/dete...
How to setup EC2 Runtime for Determined: • Distributed Training and Hyperparamet...
***minor errata on the video*** the type annotations in Determined's function definitions are just that; annotations. They let you statically test your code with the mypy linting tool, and mypy will tell you "hey you're passing invalid arguments to this type-annotated function". But at runtime, it's just normal python semantics with no automatic behaviors
Chapters
0:00 Beginning
0:48 CIFAR-10
1:51 Determined Examples
3:26 Configuration Files
8:01 Data Loader
12:23 Model Definition
18:42 Sending Experiment
20:48 PyTorch Comparison
22:09 Experiment Tracking
23:41 HP Search
26:04 Summary