BERT & NLP Explained
Speaker: Mitchell Wong, Data Scientist at Microsoft
Host: Abir Mokbel, Stream Owner at Aggregate Intellect
Motivation:
This video walks us through BERT, an open source machine learning framework for natural language processing (NLP). BERT is designed to help computers understand the meaning of ambiguous language in text by using surrounding text to establish context. This video discusses NLP, language models, how BERT works, MLM and NSP, real life applications, and limitations and future enhancements.
Website: https://ai.science/?utm_source=youtub...
DG: https://ai.science/dg?utm_source=yout...
Join slack: https://join.slack.com/t/aisc-to/shar...
Concepts & Graphic credits:
Next word: Holtzman et al 2019
Markov: https://www.cs.princeton.edu/courses/...,
Pre-training and fine-tuning: https://jalammar.github.io/illustrate...
Self-attention: https://ai.googleblog.com/2017/08/tra...
Disclaimer from Host: "All opinions expressed in this video are my own"