Partitioned Data Pipelines in Data Engineering
Partitioning is a technique that helps data engineers and ML engineers organize data and the computations that produce that data.
0:00 - Partitioned Data Assets and Pipelines
0:58 - Time Window Partitions
2:47 - Advanced Partition Dependencies
3:58 - Static Partitions
5:05 - Multi-Dimensional Partitions
6:14 - Dynamic Partitions
7:54 - Conclusion
Try Dagster today with a 30-day free trial: https://dagster.io/lp/dagster-cloud-t...