Visual AutoRegressive Modeling:Scalable Image Generation via Next-Scale Prediction
Paper: https://arxiv.org/abs/2404.02905
Demo: https://var.vision/
Code: https://github.com/FoundationVision/VAR
My notes: https://drive.google.com/file/d/1qym3...
00:00 Intro
00:53 DiTs
04:06 Autoregressive Image Transformers
06:23 Tokenization problem with AR ViTs
08:43 VAE
10:47 Discrete Quantization - VQGAN
16:42 Visual Autoregressive Modeling
21:31 Causal Inference with VAR
24:02 Losses
25:16 Residual Modeling
33:26 Summary
34:11 Results