3. Microsoft Fabric | Data Analysis with Apache Spark | PySpark | Partitioning Data on Month

Опубликовано: 03 Ноябрь 2024
на канале: Analytical Guy
239
11

▶ Have queries regarding Data Analytics or studying abroad? Get in touch!
https://topmate.io/analyticalguy

▶ Module3 Dataset Download
https://github.com/atikant-sql/Micros...

▶ Other Microsoft Fabric material for study
https://learn.microsoft.com/en-gb/tra...

▶ Study guide for DP600 Certification
https://learn.microsoft.com/en-us/cre...

Microsoft Fabric is an all-in-one analytics platform that brings together data integration, engineering, real-time analytics, and business intelligence—perfect for anyone looking to streamline their data workflows.

In this video we will perform data analysis using Apache Spark.

▶ Timeline:
00:00 Recap
THEORY —
00:35 🔍 What You'll Learn from this video
01:30 What is Apache Spark?
03:50 TIMELINE in Big Data
06:15 Hadoop vs Spark
07:00 Apache Architecture

PRACTICAL —
11:50 Microsoft Fabric Platform
12:10 Create Workspace
12:40 Create Lakehouse
13:30 Upload Folder from local
14:30 Create Notebook
16:00 Analysis using Apache spark
18:00 Changing Data Types of columns
25:00 Data Manipulation using Apache spark
28:00 Explore more using PySpark
33:00 Transform Data
40:00 How to Save the Data
45:00 Partition the Data on Month and Year

▶ Module1 : Getting started with Microsoft Fabric for Beginners | Will this impact your Job growth?
   • 1. Getting started with Microsoft Fab...  

▶ Module2 : What is Lakehouse? Step by Step guide to create a Lakehouse in Microsoft Fabric
   • 1. Getting started with Microsoft Fab...  

#MicrosoftFabric #Microsoft #PowerBI