2. SparkConf with Jupyter Notebook | DataBricks like environment on your local machine | PySpark

Опубликовано: 03 Ноябрь 2024
на канале: Talent Origin
2,478
like

Setting up PySpark environment using Anaconda Python:    • 01. Pyspark Setup With Anaconda Pytho...  

In this video lecture we will learn how to setup Spark Configuration using SparkConf and pass it to SparkSession on a local machine which is similar to Data Bricks environmet.


Other playlists from MyChannel:
   / @talentorigin  


Books I Follow:

Apache Spark Books:
Learning Spark: https://amzn.to/2pCcn8W
High Performance Spark: https://amzn.to/2Goy9ac
Advanced Analytics with Spark: https://amzn.to/2pD57Ke
Apache Spark 2.0 Cookbook: https://amzn.to/2pEbAUp
Mastering Apache Spark 2.0: https://amzn.to/2udDEUg

Scala Programming:
Programming in Scala: https://amzn.to/2uiTGfl

Hadoop Books:
Hadoop: The Definitive Guide: https://amzn.to/2pDheH4

Hive:
Programming Hive: https://amzn.to/2Gqwz7o

HBase:
HBase The Definitive Guide: https://amzn.to/2Gj9rI2

Python Books:
Learning Python: https://amzn.to/2pDqo6m