An Image Is Worth 16x16 Words - Paper Explained
In this video, I explain the paper “an image is worth 16x16 words” in which Vision Transformer is Introduced.
I first describe one of the biggest flaws in attention mechanism; which is the fact that it is computation-hungry. Then I show you how the authors of this paper got around this difficulty. We learn about Vision Transformer, a large model that can be fine-tuned for a variety of computer vision tasks; and observed that, given enough data, vision transformer outperforms CNNs.
📑 Chapters:
0:00 Abstract
0:19 Introduction
2:27 Related Works
2:48 Method
5:06 Results
6:17 Conclusion
📝 Link to the paper:
https://arxiv.org/abs/2010.11929
👥 Authors:
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani et al.
🔗 Helpful Links:
My Video on the Paper "Attention is All you Need"
• Attention Is All You Need - Paper Explained
🙏 I'd like to express my gratitude to Dr. Nasersharif, my supervisor, for suggesting this paper to me.
🙋♂️ Find me on:
Find me on: halflingwizard.me
🎁 Support the Channel:
If you’d like to support my work, you can check out my wishlist here: https://www.amazon.com/registries/gl/...
Your support helps me keep creating content like this. Thank you for being part of this journey!
#transformer #vision_transformer #computer_vision