AWS Masterclass for Data Engineers with Project
Become a Job-Ready Data Engineer: https://datavidhya.com/
Check website for latest discount
In this video, I'll walk you through building a production-grade data pipeline on AWS from scratch — step by step, entirely on the AWS Console.
We'll ingest live YouTube trending data using the YouTube Data API, process it through a Medallion Architecture (Bronze → Silver → Gold), run data quality checks, and orchestrate the entire workflow with AWS Step Functions — exactly how real companies build data lakes.
This is NOT a toy project. By the end, you'll have a fully automated pipeline that runs every 6 hours, pulls fresh data, transforms it, validates quality, and sends you alerts on success or failure.
Codes used in video - https://github.com/darshilparmar/yout...
Subscribe to FREE Data Engineering newsletter - http://blog.datavidhya.com/
👦🏻 My LinkedIn - / darshil-parmar
📷 Instagram - / datawithdarshil
🎯Twitter - / parmardarshil07
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
✨ Tags ✨
aws data pipeline, aws data engineering project, medallion architecture, build data pipeline from scratch, aws hands on tutorial, aws data engineer certification
✨ Hashtags ✨
#dataengineering #aws #project