apache spark - Unresolved dependency with xgboost library in scala -
this question has answer here:
- sbt build failed spark scala xgboost 2 answers
i've added xgboost jar files in library , modules in project structure. (i built jar files source mentioned in documentation). can't seem able resolve dependency it. i've tried run dependency included in build sbt file , taken out (since jars included in library , dependencies via project structure). both seem failing. sort of compatibility issue? running scala 2.11.8 , spark 2.1.0. dependencies included in sequence follows:
"ml.dmlc" %% "xgboost4j" % "0.7", "ml.dmlc" %% "xgboost4j-spark" % "0.7"
i seem missing not sure what. ideas?
i tried publish jar suggested following error:
sbt.resolveexception: unresolved dependency: ml.dmlc#xgboost4j_2.11;0.7: not found unresolved dependency: ml.dmlc#xgboost4j-spark_2.11;0.7: not found @ sbt.ivyactions$.sbt$ivyactions$$resolve(ivyactions.scala:313) @ sbt.ivyactions$$anonfun$updateeither$1.apply(ivyactions.scala:191) @ sbt.ivyactions$$anonfun$updateeither$1.apply(ivyactions.scala:168) @ sbt.ivysbt$module$$anonfun$withmodule$1.apply(ivy.scala:156) @ sbt.ivysbt$module$$anonfun$withmodule$1.apply(ivy.scala:156) @ sbt.ivysbt$$anonfun$withivy$1.apply(ivy.scala:133) @ sbt.ivysbt.sbt$ivysbt$$action$1(ivy.scala:57) @ sbt.ivysbt$$anon$4.call(ivy.scala:65) @ xsbt.boot.locks$globallock.withchannel$1(locks.scala:93) @ xsbt.boot.locks$globallock.xsbt$boot$locks$globallock$$withchannelretries$1(locks.scala:78) @ xsbt.boot.locks$globallock$$anonfun$withfilelock$1.apply(locks.scala:97) @ xsbt.boot.using$.withresource(using.scala:10) @ xsbt.boot.using$.apply(using.scala:9) @ xsbt.boot.locks$globallock.ignoringdeadlockavoided(locks.scala:58) @ xsbt.boot.locks$globallock.withlock(locks.scala:48) @ xsbt.boot.locks$.apply0(locks.scala:31) @ xsbt.boot.locks$.apply(locks.scala:28) @ sbt.ivysbt.withdefaultlogger(ivy.scala:65) @ sbt.ivysbt.withivy(ivy.scala:128) @ sbt.ivysbt.withivy(ivy.scala:125) @ sbt.ivysbt$module.withmodule(ivy.scala:156) @ sbt.ivyactions$.updateeither(ivyactions.scala:168) @ sbt.classpaths$$anonfun$sbt$classpaths$$work$1$1.apply(defaults.scala:1439) @ sbt.classpaths$$anonfun$sbt$classpaths$$work$1$1.apply(defaults.scala:1435) @ sbt.classpaths$$anonfun$dowork$1$1$$anonfun$90.apply(defaults.scala:1470) @ sbt.classpaths$$anonfun$dowork$1$1$$anonfun$90.apply(defaults.scala:1468) @ sbt.tracked$$anonfun$lastoutput$1.apply(tracked.scala:37) @ sbt.classpaths$$anonfun$dowork$1$1.apply(defaults.scala:1473) @ sbt.classpaths$$anonfun$dowork$1$1.apply(defaults.scala:1467) @ sbt.tracked$$anonfun$inputchanged$1.apply(tracked.scala:60) @ sbt.classpaths$.cachedupdate(defaults.scala:1490) @ sbt.classpaths$$anonfun$updatetask$1.apply(defaults.scala:1417) @ sbt.classpaths$$anonfun$updatetask$1.apply(defaults.scala:1369) @ scala.function1$$anonfun$compose$1.apply(function1.scala:47) @ sbt.$tilde$greater$$anonfun$$u2219$1.apply(typefunctions.scala:40) @ sbt.std.transform$$anon$4.work(system.scala:63) @ sbt.execute$$anonfun$submit$1$$anonfun$apply$1.apply(execute.scala:228) @ sbt.execute$$anonfun$submit$1$$anonfun$apply$1.apply(execute.scala:228) @ sbt.errorhandling$.wideconvert(errorhandling.scala:17) @ sbt.execute.work(execute.scala:237) @ sbt.execute$$anonfun$submit$1.apply(execute.scala:228) @ sbt.execute$$anonfun$submit$1.apply(execute.scala:228) @ sbt.concurrentrestrictions$$anon$4$$anonfun$1.apply(concurrentrestrictions.scala:159) @ sbt.completionservice$$anon$2.call(completionservice.scala:28) @ java.util.concurrent.futuretask.run(futuretask.java:266) @ java.util.concurrent.executors$runnableadapter.call(executors.java:511) @ java.util.concurrent.futuretask.run(futuretask.java:266) @ java.util.concurrent.threadpoolexecutor.runworker(threadpoolexecutor.java:1142) @ java.util.concurrent.threadpoolexecutor$worker.run(threadpoolexecutor.java:617) @ java.lang.thread.run(thread.java:745) [error] (*:update) sbt.resolveexception: unresolved dependency: ml.dmlc#xgboost4j_2.11;0.7: not found [error] unresolved dependency: ml.dmlc#xgboost4j-spark_2.11;0.7: not found [error] total time: 24 s, completed aug 15, 2017 12:40:52 pm
the dependency should have 1 % there.
"ml.dmlc" % "xgboost4j" % "0.7", "ml.dmlc" % "xgboost4j-spark" % "0.7"
Comments
Post a Comment