PySpark Learning Series | 07-Create DataFrames from Parquet, JSON and CSV
PySpark Learning Series | 07-Create DataFrames from Parquet, JSON & CSV
In this video we will learn how to create dataframe from parquet file, how to create dataframe from JSON file and how to create dataframe from csv file in pyspark. We will also learn what is meant by inferschema in csv file. We will use spark.read.load command to load the files into dataframes.