Step 1 - Creating a Spark session

Let's create a Spark session by defining the number of computing cores, the SQL warehouse, and the application name as follows:

val spark = SparkSession
.builder
.master("local[*]")
.config("spark.sql.warehouse.dir", "C:/data/")
.appName(s"LDA")
.getOrCreate()
..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset