RL Foundation Models Are Coming!
AdA is a new algorithm out from DeepMind that combines interesting ideas like curriculum learning, meta reinforcement learning (via RL^2), model-based reinforcement learning, attention, and memory models to develop a prototype for a reinforcement learning foundation model. The results look promising, and the future of this area looks bright!
Outline
0:00 - Intro
1:07 - Example Video
2:40 - ClearML
3:48 - How It Works Overview
4:20 - Meta-Learning & RL
8:20 - Attention & Memory
9:55 - Distillation
12:01 - Auto-Curriculum Learning
15:18 - Results
27:14 - Takeaways & Future Work
ClearML - https://bit.ly/3GtCsj5
Social Media:
YouTube - / edanmeyer
Twitter - / ejmejm1
Sources:
AdA Paper: https://arxiv.org/abs/2301.07608
Museli Paper: https://arxiv.org/abs/2104.06159
Primacy Bias Paper: https://arxiv.org/abs/2205.07802