FAST neural style transfer | the power of encoder-decoders | deploying computer vision models online
While artistic deep learning methods like style transfer allow us to create beautiful art with everyday images, the original methods need to perform backpropagation on each image renders this method insufficient for real time applications.
Utilizing the power of the encoder-decoder model type, researchers have found ways to run this model in real time. Today, we’ll be looking at some of those methods and stylizing a video using a pretrained model for fast, real time, arbitrary style transfer.
#fancyfueko #styletransfer #realtime
Introduction (0:00)
Style Transfer Recap (0:17)
Encoder Decoder Models for Fast Style Transfer (1:02)
Arbitrary Style Transfer (2:26)
Realtime Deployment (3:00)
Related Videos + Subscribe (4:33)
Papers in this video:
Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "Image style transfer using convolutional neural networks." Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.
Johnson, Justin, Alexandre Alahi, and Li Fei-Fei. "Perceptual losses for real-time style transfer and super-resolution." European conference on computer vision. Springer, Cham, 2016.
Ghiasi, Golnaz, et al. "Exploring the structure of a real-time, arbitrary neural artistic stylization network." arXiv preprint arXiv:1705.06830 (2017).
TPU Image Source:
By Zinskauf - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index...
Frameworks/code in this video (github repos)
https://github.com/ifueko/arbitrary-n...
https://github.com/magenta/magenta/tr...
https://github.com/microsoft/onnxjs
https://github.com/NVIDIA/TensorRT
https://github.com/tensorflow/tfjs
Artwork in this video:
Jean-Michel Basquiat, Untitled, 1981. The Broad Art Foundation, Santa Monica
Jean-Michel Basquiat, Untitled, 1982. Courtesy of Sotheby’s.
Jean-Michel Basquiat, Untitled, 1982. Courtesy of Sotheby’s.
Jean-Michel Basquiat. CABEZA, 1985/2005. Marcel Katz Art
Jean-Michel Basquiat, UNTITLED HEAD 1983. 2001 Marcel Katz Art.
Jean-Michel Basquiat, Self-portrait, 1984. Gagosian
Jean-Michel Basquiat, Untitled, 1982. Christie's
Jean-Michel Basquiat, In This Case, 1983. Private collection.
Originally found from https://www.artsy.net/article/artsy-e...
and https://en.wikipedia.org/wiki/In_This...
If you like this video, subscribe to my channel:
/ @fancyfueko
Follow me on IG: @fancyfueko
/ fancyfueko