Spark Internals and Architecture in Azure Databricks
Spark is an open source distributed computing engine. We use it for processing and analyzing a large amount of data. Likewise, hadoop mapreduce, it also works to distribute data across the cluster. It helps to process data in parallel. Spark uses master/slave architecture, one master node, and many slave worker nodes.
0:00 - Overview
0:34 - Introduction
1:27 - Architecture of Spark
357 - Run spark
5:58 - Spark session
6:59 - Run queries
11:05 - Evolution of spark
12:15 - Summary
This is one of my lecture from the course published in Infrasity, if you are looking for Databricks Introductory course, you may purchase the course:
https://infrasity.com/p/azure-databri...
▬▬▬▬▬▬ Other Course link: 🔗▬▬▬▬▬▬
Terraform Course :https://infrasity.com/p/devops-fundam...
Azure Kubernetes Service:https://infrasity.com/p/complete-guid...
Azure Devops :
https://infrasity.com/p/master-azure-...
Azure :https://infrasity.com/p/azure-basics-...
HELM : https://infrasity.com/p/helm-master-c...
Github Actions:
:https://infrasity.com/p/build-deploy-...
Terraform Cloud : https://infrasity.com/p/infrastructur...
Vault:
https://infrasity.com/p/hashicorp-vau...
▬▬▬▬▬▬ About Infrasity 🔗▬▬▬▬▬▬
Single platform for all the devops courses - We help devops enthusiasts discover courses which will help them learn infrastructure and apply them on real environment 🚀
Learn more about Infrasity :https://infrasity.com/https:/
📌 Follow us on Social and be a part of an amazing tech community📌
👉 you tube-https://www.youtube.com/results?searc...
👉 Check out student success stories, expert opinions, and live classes
on Linkedin - / infrasity
👉 Explore value-packed reels, carousels and get access to exclusive updates on Instagram - / infrasity
🔔 Hit that bell icon to get notified of all our new videos 🔔
If you liked this video, please don't forget to like and comment. Never miss out on our exclusive videos to help boost your coding career! follow infrasity now for more updates !
▬▬▬▬▬▬ Github Repo's 🔗▬▬▬▬▬▬
Hashicorp vault: https://github.com/shan0809/hashicorp...
Terraform : https://github.com/shan0809/Jumpstart...
HELM : https://github.com/shan0809/HELMChart
Databricks :https://github.com/shan0809/Azure-Dat...
Azure Kubernetes service :https://github.com/shan0809/AzureKube...
AzureDevOps : https://github.com/shan0809/Azure-Dev...
Githubactionsdemo:https://github.com/shan0809/githubact...
🔵 Why should you opt for an Azure data factory course ?
It allows organizations to create data-driven workflows in the cloud for orchestrating and automating data movement and for data transformation. By using leveraging Azure Data Factory, the casino can create and schedule pipelines, or data-driven workflows, that can ingest data from different data stores.