TensorFlow Tutorial 19 - Custom Dataset for Text with TextLineDataset
In this video I will show you how to create an input pipeline when dealing with text. We focus on TextLineDataset which is a quite general method that you can adapt to many different text data structure. In the tutorial I show you mainly demonstrating how to load the imdb dataset from a text file but I also try and give you some ideas and what to do if you're dealing with text data is differently structured, like split over multiple text files or a translation dataset split over two text files.
Download the data (IMDB) used in the video here:
https://www.kaggle.com/dataset/ff33c5...
❤️ Support the channel ❤️
/ @aladdinpersson
Paid Courses I recommend for learning (affiliate links, no extra cost for you):
⭐ TensorFlow Specialization https://bit.ly/3FmEVK1
⭐ Machine Learning Specialization https://bit.ly/3hjTBBt
⭐ Deep Learning Specialization https://bit.ly/3YcUkoI
📘 MLOps Specialization http://bit.ly/3wibaWy
📘 GAN Specialization https://bit.ly/3FmnZDl
📘 NLP Specialization http://bit.ly/3GXoQuP
✨ Free Resources that are great:
NLP: https://web.stanford.edu/class/cs224n/
CV: http://cs231n.stanford.edu/
Deployment: https://fullstackdeeplearning.com/
FastAI: https://www.fast.ai/
💻 My Deep Learning Setup and Recording Setup:
https://www.amazon.com/shop/aladdinpe...
GitHub Repository:
https://github.com/aladdinpersson/Mac...
✅ One-Time Donations:
Paypal: https://bit.ly/3buoRYH
▶️ You Can Connect with me on:
Twitter - / aladdinpersson
LinkedIn - / aladdin-persson-a95384153
Github - https://github.com/aladdinpersson
OUTLINE:
0:00 - Introduction and Dataset Overview
1:39 - Load using TextLineDataset
4:13 - Filtering Dataset
8:12 - Creating Vocabulary
13:43 - Numericalizing with TokenTextEncoder
18:10 - Applying map on datasets
20:35 - Simple Model
22:30 - Dataset in Several Files
25:50 - Sketch Load Translation Dataset
29:22 - Ending