Finding DUPLICATES IN TABULAR DATA with Jupyter and Prodigy
Prodigy is a modern annotation tool for collecting training data for machine learning models, developed by the makers of spaCy. In this video, we'll show you how to use Prodigy to train a named entity recognition model from scratch, by taking advantage of semi-automatic annotation and modern transfer learning techniques.
[00:00] The Deduplication Task
[03:23] Exploring in Jupyter
[08:44] Using recordlinkage
[13:31] Prodigy
[17:05] Understanding Prodigy Recipes
[21:53] Building a Custom Recipe
[32:12] Learning from Labelling
[36:57] Improving the Interface
[40:35] Lessons Learned
PRODIGY
● Website & docs: https://prodi.gy
● Live demo: https://prodi.gy/demo
● Forum: https://support.prodi.gy
THIS TUTORIAL
● Code & data: https://github.com/explosion/prodigy-...
● Jupyter Notebook: https://github.com/explosion/prodigy-...
● Recordlinkage Docs: https://recordlinkage.readthedocs.io/...
● Jinja2 Docs: https://jinja.palletsprojects.com/en/...
● Custom Prodigy Recipe Docs: https://prodi.gy/docs/custom-recipes
FOLLOW US
● Explosion: / explosion_ai
● We offer new services! spaCy Custom Solutions✨ https://explosion.ai/custom-solutions