Perform the following steps to develop a Spark application on IntelliJ IDEA with SBT:
- Add the sbt-idea plugin.
- Add SBT to the global plugin file:
$ mkdir /home/hduser/.sbt/0.13/plugins
$ echo addSbtPlugin("com.github.mpeltone" % "sbt-idea" % "1.6.0" ) > /home/hduser/.sbt/0.12/plugins/plugin.sbt
- Alternatively, you can add the SBT plugin to your project as well:
$ cd <project-home>
$ echo addSbtPlugin("com.github.mpeltone" % "sbt-idea" % "1.6.0" ) > plugin.sbt
IDEA is ready for use with SBT.
Now you can develop the Spark code using Scala and build it using SBT.