Adding Self-Attention to a Convolutional Neural Network! PyTorch Deep Learning Tutorial
TIMESTAMPS:
0:00 Introduction
0:22 Attention Mechanism Overview
1:20 Self-Attention Introduction
3:02 CNN Limitations
4:09 Using Attention in CNNs
6:30 Attention Integration in CNN
9:06 Learnable Scale Parameter
10:14 Attention Implementation
12:52 Performance Comparison
14:10 Attention Map Visualization
14:29 Conclusion
In this video I show how we can add Self-Attention to a CNN in order to improve the performance of our classifier!
Donations
https://www.buymeacoffee.com/lukeditria
The corresponding code is available here! (Section 13)
https://github.com/LukeDitria/pytorch...
Discord Server:
/ discord