PySpark Learning Series | 06-Hive Integration & Spark SQL | Read/Write data from/to Hive
PySpark Learning Series | 06-Hive Integration & Spark SQL | Read/Write data from/to Hive
In this video we will see how we can integrate hive in spark and how we can use hive in spark. How we can create dataframe from a hive table or how we can read data from a huge table in spark. How we can write a dataframe into a hive table.
We will also see what is spark sql and how we can run sql queries in spark or pyspark.
We will see basic hive commands to load table and create hive table
Spark Basics: • PySpark Learning Series | 01-Spark Basics
Spark Installation on Windows: • PySpark Learning Series | 02-Spark Install...
Spark Architecture: • PySpark Learning Series | 03-Spark Archite...