AWS Glue ETL with Python shell |Read data from S3 and insert Redshift

Опубликовано: 12 Октябрь 2024
на канале: Techno Devs with Saurabh
5,620
77

AWS Glue ETL with Python shell
Read data from S3 and insert into Redshift using Python Shell script


AWS Glue is a fully managed ETL service that makes it easy for customers to prepare and load their data. it have two option we can create glue script using python as well as spark.

Using AWS Glue I have create Python script and store data into Redshift table.
library used :
boto3
pandas
psycopg2


https://github.com/saurabhgarg013/My_...

AWS GLUE ETL AND REDSHIFT RELATED DATA ENGINEERING VIDEOS.

(Create Redshift Cluster and Load Data using Python)
   • Create Redshift Cluster and Load Data...  
(AWS Glue ETL with Python shell |Read data from S3 and insert Redshift)(Not using Pyspark with glue)
   • AWS Glue ETL with Python shell |Read ...  
(AWS GLUE Complete ETL Project Demo| Load Data from AWS S3 to Amazon RedShift)(Data engineer Project)
   • AWS GLUE Complete ETL Project Demo| L...  
(Redshift using Python| Load and insert and copy data into redshift using psycopg2 )
   • Redshift using Python| Load and inser...  
(Aws Redshift tutorial |Amazon Redshift Architecture | Data Warehouse Concept)
   • Aws Redshift tutorial |Amazon Redshif...  
(Building ETL Pipeline using AWS Glue and Step Functions)
   • Building ETL Pipeline using AWS Glue ...  
(AWS GLUE CRAWLER TUTORIAL with DEMO| Learn AWS GLUE)
   • AWS GLUE CRAWLER TUTORIAL with DEMO| ...  
(AWS GLUE CONCEPT|GLUE DATA CATALOG|GLUE TUTORIAL)
   • AWS GLUE CONCEPT|GLUE DATA CATALOG|GL...  



AWS ATHENA AND LAMBDA RELATED
   • ATHENA COMPLETE TUTORIAL WITH DEMO |A...   (ATHENA COMPLETE TUTORIAL WITH DEMO |AWS ATHENA TABLE PARTITION|DEMO)
   • How to run Athena query from AWS Lamb...   (How to run Athena query from AWS Lambda DEMO|AWS ATHENA FROM LAMBDA)
   • Athena using Python  for Beginners demo   (Athena using Python for Beginners)


In case of any query, you can contact us directly on WhatsApp 8800502668
and you can write mail [email protected]

Request you to subscribe my channel Techno Devs with Saurabh and Press Bell icon & get regular updates on videos.