Mastering AWS Glue Unit Testing for PySpark Jobs with Pytest
This video is a step-by-step guide on how to write unit tests to test functions in a pyspark job that works on the AWS Glue Service. This video will cover how to write sample dataset to test our glue job transformations to make sure they are doing what we are expecting.
Buy me a Coffee - https://www.buymeacoffee.com/dataengu
Tutorial Links:
Configure Docker with AWS Glue Jobs - • Develop AWS Glue Jobs Locally Using PyChar...
#aws, #awsglue, #pytest, #pyspark