#spark
If you need any guidance you can book time here, https://topmate.io/bhawna_bedi56743
Follow me on Linkedin
/ bhawna-bedi-540398102
Instagram
https://www.instagram.com/bedi_foreve...
You can support my channel at: bhawnabedi15@okicici
COLLECT_LIST()
It is an aggregate function which returns an array that has all values in expr with the group.
It is used to create an array type column on data frame by merging rows, typically after group by or window partitions.
Order of elements inside array is maintained.
COLLECT_SET()
collect_set() dedupes and eliminates the duplicates and results in unique values.
Order of elements inside array is not maintained.
ARRAY_DISTINCT()
It can be easily used array_distinct() before collect_list() function to eliminate the duplicated values without losing the sequence of the elements in the array.
Data-bricks hands on tutorials
• Databricks hands on tutorial(Pyspark/...
Azure Event Hubs
• Azure Event Hubs
Azure Data Factory Interview Question
• Azure Data Factory Interview Questions
SQL leet code Questions
• SQL Interview Questions(LeetCode/Hack...
Azure Synapse tutorials
• Azure Synapse Analytics Hands-on Tuto...
Azure Event Grid
• Event Grid
Azure Data factory CI-CD
• CI-CD in Azure Data Factory
Azure Basics
• Azure Basics
Data Bricks interview questions
• DataBricks Interview Questions