Building ETL Pipeline using AWS Glue and Step Functions
Manage AWS Glue Jobs with Step Functions
Create an ETL solution using AWS Step Functions
also send notification when job succeeded by event bridge.
In this video , we create workflow using AWS Glue, AWS Step Function and AWS Event Bridge and SNS service.
we follows below steps.
1.create glue crawler and Glue ETL job
2.Create step function to execute Crawler and glue ETL job
3.Create SNS topic which send mail.
4.Event bridge trigger SNS when Glue ETL job succeeded.
THANK YOU FOR WATCHING .. PLEASE LIKE SHARE AND SUBSCRIBE
AWS GLUE ETL AND REDSHIFT RELATED DATA ENGINEERING VIDEOS.
• Create Redshift Cluster and Load Data usin... (Create Redshift Cluster and Load Data using Python)
• AWS Glue ETL with Python shell |Read data ... (AWS Glue ETL with Python shell |Read data from S3 and insert Redshift)(Not using Pyspark with glue)
• AWS GLUE Complete ETL Project Demo| Load D... (AWS GLUE Complete ETL Project Demo| Load Data from AWS S3 to Amazon RedShift)(Data engineer Project)
• Redshift using Python| Load and insert and... (Redshift using Python| Load and insert and copy data into redshift using psycopg2 )
• Aws Redshift tutorial |Amazon Redshift Arc... (Aws Redshift tutorial |Amazon Redshift Architecture | Data Warehouse Concept)
• Building ETL Pipeline using AWS Glue and S... (Building ETL Pipeline using AWS Glue and Step Functions)
• AWS GLUE CRAWLER TUTORIAL with DEMO| Learn... (AWS GLUE CRAWLER TUTORIAL with DEMO| Learn AWS GLUE)
• AWS GLUE CONCEPT|GLUE DATA CATALOG|GLUE TU... (AWS GLUE CONCEPT|GLUE DATA CATALOG|GLUE TUTORIAL)
• How to create Redshift Connection using AW... (AWS GLUE REDSHIFT CONNECTION)
Master AWS Data Engineering in Hindi – Complete Course! 🇮🇳
🔥 Learn from Real-World Projects | Only at $45 🔥
📚 Are you ready to become a cloud data engineer?
Check out my Udemy course designed completely in Hindi, perfect for beginners and experienced professionals!
✅ Course Link: https://www.udemy.com/course/master-a...
What you'll learn:
✔️ AWS S3 – Best Practices
✔️ AWS Lambda - Best Practices
✔️ AWS Database - Best Practices
✔️ AWS Glue – ETL pipelines using PySpark
✔️ Amazon EMR – Big Data processing with Spark
✔️ Amazon Redshift – Data Warehousing concepts
✔️ Apache Airflow (MWAA) – Workflow orchestration
✔️ AWS Step Functions – Pipeline automation
✔️ Real-time & Batch Data Flow
✔️ Complete Project Architecture explained
Personal Mentorship Available
If you're working on a data engineering project and need guidance, feel free to reach out —
I'll personally help you with your architecture, design, or implementation doubts.
📞 Contact for queries or support:
📧 Email: [email protected]
📱 WhatsApp: +91-8800502668
⏰ Limited time offer – Course available for only $45!
Start your cloud data career today! 🚀