Applying Functions to Pyspark DataFrame - PySpark Tutorials for Beginners
In this video, I have explained about the PySpark DataFrame API.
- Creating a new dataframe by loading a csv file
- Creating a user defined pyspark function (UDF)
- Invoking the function to split two columns in a dataframe
- Drop columns in a PySpark Dataframe
Connect with me here:
LinkedIn: www.linkedin.com/in/meenakshi-lakshmanan
Subscribe to my channel:
https://youtube.com/channel/UCCeaY00S...
Provide your valuable feedback to,
Email: [email protected]