Introduction This article will cover how to query Postgresql from Spark, using Scala. To know more about Scala, check out any of the previous Scala articles. Spark PostgreSQL Dependencies Below, find dependencies needed to add to the build.sbt file. libraryDependencies += “org.postgresql” % “postgresql” % “42.2.5”libraryDependencies += “org.apache.spark” %% “spark-mllib” % sparkVersion % Provided To … Read morePostgresql from Spark, how to query?
Introduction to Scala Methods In order to understand this article, one should understand Scala Variables. After learning about Scala Variables, you can learn about Scala Methods. What is a method? A method, sometimes called a function, in computer programming, is a black box which takes input(s), executes one or more operations, and finally yields an output … Read moreScala Methods – Syntax, Declaration, Use case, Examples
SBT plugin – Introduction To create a SBT plugin, I am using SBT 1.2.6 and Scala 2.12.x. My consumer project is using SBT 1.2.6 and Scala 2.11.12. When you build a plugin, the requirements are: SBT version of the plugin needs to be the same as the SBT version of your project. SBT version of … Read moreSBT Plugin – How to make it, debug it, improve it?