Mastering AWS Glue Unit Testing for PySpark Jobs with Pytest
DataEng Uncomplicated DataEng Uncomplicated
17.5K subscribers
3,552 views
0

 Published On Oct 27, 2023

This video is a step-by-step guide on how to write unit tests to test functions in a pyspark job that works on the AWS Glue Service. This video will cover how to write sample dataset to test our glue job transformations to make sure they are doing what we are expecting.


Buy me a Coffee - https://www.buymeacoffee.com/dataengu

Tutorial Links:
Configure Docker with AWS Glue Jobs -    • Develop AWS Glue Jobs Locally Using P...  
#aws, #awsglue, #pytest, #pyspark

show more

Share/Embed