AWS Glue: Write Parquet With Partitions to AWS S3

Опубликовано: 10 Октябрь 2024
на канале: DataEng Uncomplicated
17,826
276

This is a technical tutorial on how to write parquet files to AWS S3 with AWS Glue using partitions. This will include how to define our data in aws glue catalog on write

timestamps
00:00 Introduction
00:30 Remap Columns in dataframe
02:57 Write to Parquet - getSink Method

read csv in aws glue:    • AWS Glue: Read CSV Files From AWS S3 ...