Develop AWS Glue Jobs Locally Using PyCharm and Docker on Windows - step by step
This Video is a step-by-step tutorial on configuring your Windows computer to work with Python Professional and Docker to run AWS Glue Jobs. This video will walk through how to configure AWS Glue 4.0.
timeline
00:00 Introduction
01:11 Pull aws glue docker image
02:46 Configure Python interrupter with docker
04:16 Set up AWS Glue-related code completion suggestions
07:06 Configure Environment Variables
08:26 Update Docker Container Settings
10:32 Test the setup
Buy me a Coffee - https://www.buymeacoffee.com/dataengu
Tutorial Links:
AWS Documentation - https://aws.amazon.com/blogs/big-data...
AWS Glue 4.0 Image on Docker Hub - https://hub.docker.com/layers/amazon/...
aws-glue-libs: https://github.com/awslabs/aws-glue-libs
sample glue script: https://github.com/AdrianoNicolucci/d...
#aws #dataengineering #awsglue