Rasa Algorithm Whiteboard - Transformers & Attention 1: Self Attention
This is the first video on attention mechanisms. We'll start with self attention and end with transformers.
We're going at it step by step, but if you're interested in immediately reading all about it in full detail then we might recommend these online documents:
http://www.peterbloem.nl/blog/transfo...
http://jalammar.github.io/illustrated...
http://d2l.ai/chapter_attention-mecha...
The general github repo for this playlist can be found here: https://github.com/RasaHQ/algorithm-w....
Want to try Rasa directly in your browser?
👉 Get started now with the Rasa Playground: https://hellorasa.info/46d6unl