Zomato AI Data Analytics | End-To-End AI Data Engineering Project
Become a Job-Ready Data Engineer - https://datavidhya.com/
Build a complete AI Data Engineering project from scratch — Zomato/food delivery dataset → AWS S3 → Snowflake → dbt → Apache Airflow → AI (OpenAI).
In this end-to-end data engineering project, you'll learn how to:
✅ Load 10M+ orders from S3 into Snowflake
✅ Build Bronze/Silver/Gold medallion layers with dbt & data quality tests
✅ Orchestrate the entire pipeline with Airflow
✅ Add an AI layer: LLM review enrichment, RAG (chat with your reviews) & text-to-SQL (chat with your warehouse) using OpenAI
Project Resources - https://github.com/darshilparmar/zoma...
Timestamp:
0:00 Intro — What We're Building
3:25 Business Problem & Architecture
11:09 Dataset & Data Model
16:42 Loading Raw Data into Amazon S3
27:24 Snowflake Setup & S3 Integration
1:00:34 Loading Raw Data into Snowflake
1:11:17 dbt Setup & Staging Layer
1:46:40 Gold Layer — Facts, Dimensions & Data Marts
2:03:48 dbt Tests, Docs & Lineage
2:10:21 Orchestrating with Apache Airflow
2:28:14 AI & LLM Fundamentals for Data Engineers
2:59:36 AI Layer 1 — LLM Enrichment
3:24:36 AI Layer 2 — RAG Chatbot on Your Data
3:51:56 AI Layer 3 — Text-to-SQL
4:16:48 Orchestrating the Full AI Pipeline
4:25:03 Recap, Next Steps & Cleanup
📷 Instagram - / datawithdarshil
👦🏻 My LinkedIn - / darshil-parmar
🎯Twitter - / parmardarshil07
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
✨ Tags ✨
✨ Hashtags ✨
#dataengineering #dbt #ai