Postgresql from Spark, how to query?


Introduction This article will cover how to query Postgresql from Spark, using Scala. To know more about Scala, check out any of the previous Scala articles. Spark PostgreSQL Dependencies Below, find dependencies needed to add to the build.sbt file. libraryDependencies += “org.postgresql” % “postgresql” % “42.2.5”libraryDependencies += “org.apache.spark” %% “spark-mllib” % sparkVersion % Provided To … Read more

SBT Plugin – How to make it, debug it, improve it?

SBT Plugin project structure

SBT plugin – Introduction To create a SBT plugin, I am using SBT 1.2.6 and Scala 2.12.x. My consumer project is using SBT 1.2.6 and Scala 2.11.12. When you build a plugin, the requirements are: SBT version of the plugin needs to be the same as the SBT version of your project. SBT version of … Read more

%d bloggers like this: