Data Lakehouse workflow Apache Iceberg and Nessie | How Iceberg works | Nessie Branch & Merge
In this video we cover a few of the key components of data lake house. We have covered the data lakehouse setup in the previous video. Link below. We go over Apache Iceberg and see how it works with actual examples. In addition, we cover Nessie’s catalog and go over branching and merging with actual examples. If you have work with Git then you will feel at home with Nessie.
Link to Data Lakehouse video: • Create on premise Data Lakehouse with Apac...
Link to GitHub repo: https://github.com/hnawaz007/pythonda...
Nessie's Commands to Create, Use, Merge and Delete Branch:
CREATE BRANCH IF NOT EXISTS dev IN nessie
USE Branch dv IN nessie
SHOW BRANCHES IN Nessie
MERGE BRANCH dev INTO main IN Nessie
DROP BRANCH dev AT COMMIT "1b65a4f0d7bb16a013fd4ae26b1952512bef23cf91ff0feb88ae006bdfea4032"
Link to Data Lake Video:
On-premis: • How to build on-premise Data Lake? | Build...
AWS: • How to create an AWS S3 Data Lake? | AWS S...
💥Subscribe to our channel:
/ haqnawaz
📌 Links
-----------------------------------------
#️⃣ Follow me on social media! #️⃣
🔗 GitHub: https://github.com/hnawaz007
📸 Instagram: / bi_insights_inc
📝 LinkedIn: / haq-nawaz
🔗 / hnawaz100
-----------------------------------------
#dataanalytics #datalakehouse #opensource
Topics covered in this video:
==================================
0:00 - Introduction to Agenda
0:31 - Apache Iceberg Overview
1:21 - Apache Iceberg Features
2:17 - Apache Iceberg Achitecture
2:44 - Apache Iceberg Metadata File(s)
5:27 - Benefits of Table Format
5:57 - Add Nessie Catalog
6:09 - Nessie Overview
6:35 - Nessie Concepts
7:06 - Nessie Branch & Merging
9:51 - Branching Strategy