scala - Typesafe config missing key in intellij -
i want run spark app put configurations in configuration file using typesafe config library. however, everytime try run code using library, error saying typesafe config cannot find key (so missingkey errors).
my project's folder looks this:
-project -assembly.sbt -build.properties -src -main -resources -myapp.conf -scala -com/myapp/app.scala -test -build.sbt i want use typesafe config configuration data , store configs in myapp.conf. file looks this:
cassandra { host = "localhost" keyspace = "kspace" table = "data" } spark { master = "localhost" appname = "myapp" } the myapp.scala file loads configs , uses them setup sessions , context:
val config = configfactory.load("myapp") val hosts = config.getstring("cassandra.host") val keyspace = config.getstring("cassandra.keyspace") val table = config.getstring("cassandra.table") val appname = config.getstring("spark.appname") val master = config.getstring("spark.master") val sparkconf = new sparkconf(true) .set("spark.cassandra.connection.host", host) val sc = new sparkcontext(master, appname, sparkconf) the following content of sbt:
name := "myapp" version := "1.0" scalaversion := "2.11.8" librarydependencies ++= seq( "org.apache.commons" % "commons-lang3" % "3.5", "com.datastax.spark" % "spark-cassandra-connector_2.11" % "2.0.2", "com.typesafe.play" % "play-json_2.11" % "2.6.0-m5" exclude("com.fasterxml.jackson.core","jackson-databind"), "org.apache.spark" %% "spark-core" % "2.2.0" % "provided", "org.apache.spark" %% "spark-sql" % "2.2.0" % "provided", "com.typesafe" % "config" % "1.3.1" ) does see doing wrong here?
Comments
Post a Comment