MoCo (+ v2): Unsupervised learning in computer vision
In this video, I present an elaborate explanation of the MoCo (Momentum Contrast) framework, encompassing both MoCo and MoCo v2 versions. This innovative approach serves as a novel method for pretraining computer vision models in an unsupervised manner. By leveraging extensive collections of unlabeled images, this technique effectively enhances the overall generalizability of our models.
Paper link: https://arxiv.org/abs/1911.05722
Table of Content:
00:00 Introduction
00:27 Unsupervised Learning in NLP
01:28 Analogy in Computer Vision
02:51 Contrastive Learning
09:35 Larger dictionary
10:44 MoCo
14:31 PyTorch pseudocode of MoCo
21:17 Additional notes
24:57 Results
27:16 MoCo V2
Icon made by Freepik from flaticon.com