Understand Azure Data factory Pipeline, activities, linked service

Опубликовано: 15 Октябрь 2024
на канале: Infrasity
650
like

A DevOps pipeline is a set of automated processes and tools that allows developers and operations professionals to collaborate on building and deploying code to a production environment.

Azure Data Factory and Azure Synapse Analytics can have one or more pipelines. A pipeline is a logical grouping of activities that together perform a task. The activities in a pipeline define actions to perform on your data. For example, you might use a copy activity to copy data from SQL Server to Azure Blob storage. Then, you might use a Hive activity that runs a Hive script on an Azure HDInsight cluster to process data from Blob storage to produce output data. Finally, you might use a second copy activity to copy the output data to Azure Synapse Analytics, on top of which business intelligence (BI) reporting solutions are built. For more information about pipelines and activities, see Pipelines and activities.

0:00 - introduction
0:20 - Overview
1:58 - properties of Microsoft Azure
3:10 - New connection (Azure Blog storage )
5:00 - File format setting
5:13 - How to preview data
7:20 - summary of code
8:56 - How to run pipeline
9:40 - Summary


This is one of my lecture from the course published in Infrasity, if you are looking for Terraform Introductory course, you may purchase the course:https://infrasity.com/p/devops-fundam...

▬▬▬▬▬▬ Other Course link: 🔗▬▬▬▬▬▬

Databricks:https://infrasity.com/p/azure-databri...

Azure Kubernetes Service:https://infrasity.com/p/complete-guid...

Azure Devops : https://infrasity.com/p/master-azure-...

Azure :https://infrasity.com/p/azure-basics-...

HELM :https://infrasity.com/p/helm-master-c...

Github Actions:https://infrasity.com/p/build-deploy-...

Terraform Cloud :https://infrasity.com/p/infrastructur...

Vault:https://infrasity.com/p/hashicorp-vau...

▬▬▬▬▬▬ About Infrasity 🔗▬▬▬▬▬▬

Single platform for all the devops courses-We help devops enthusiasts discover courses which will help them learn infrastructure and apply them on real environment 🚀

Learn more about infrasity :https://infrasity.com/

📌 Follow us on Social and be a part of an amazing tech community📌

👉 you tube-https://www.youtube.com/results?searc...

👉 Check out student success stories, expert opinions, and live classes on Linkedin -   / infrasity  

👉 Explore value-packed reels, carousels and get access to exclusive updates on Instagram -   / infrasity  

🔔 Hit that bell icon to get notified of all our new videos 🔔

If you liked this video, please don't forget to like and comment. Never miss out on our exclusive videos to help boost your coding career! follow infrasity now for more updates !

▬▬▬▬▬▬ Github Repo’s 🔗▬▬▬▬▬▬

Hashicorp vault: https://github.com/shan0809/hashicorp...

Terraform : https://github.com/shan0809/Jumpstart...

HELM : https://github.com/shan0809/HELMChart

Databricks :https://github.com/shan0809/Azure-Dat...

Azure Kubernetes service :https://github.com/shan0809/AzureKube...

AzureDevOps : https://github.com/shan0809/Azure-Dev...

Githubactionsdemo:https://github.com/shan0809/githubact...