VQ-VAE | Everything you need to know about it | Explanation and Implementation
In this video I go over Vector Quantised Variational Auto Encoder(VQVAE).
Specifically I talk over how its different from VAE, its theory and implementation.
I also train a VQVAE model in pytorch and show how the generation process looks like after we have trained a VQVAE model.
Timestamps
--------------------
00:00 Intro
00:27 Need and difference from VAE
02:43 VQ VAE Components
04:31 Argmin and Straight Through Gradient Estimation
07:11 Codebook and Commitment Loss in VQ-VAE
08:45 KL Divergence Loss
09:30 VQ-VAE PyTorch Implementation
12:35 Visualization
14:29 Generating Images using VQVAE
16:37 Outro
Paper Link - https://tinyurl.com/exai-vqvae-paper
Subscribe - https://tinyurl.com/exai-channel-link
Inspiration of visualization of embedding taken from - • [VQ-VAE] Neural Discrete Representation Le...
Github Repo Link - https://tinyurl.com/exai-vqvae-repo (Will be updated soon)
Background Track Fruits of Life by Jimena Contreras
Email - [email protected]