You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Will lightning work with the Apache Toree Jupyter Kernel? Toree allows Jupyter the ability to run Spark commands. It works with both Scala and Python(PySpark).
When I add the lightning-scala Jar in Jupyter I get an error. Here is the command I run
%addJar file:/Users/kvenkatesa/dev/lightning-scala/target/scala-2.10/lightning-scala-assembly-0.1.0-SNAPSHOT.jar
I get the following error in the Jupyter log:
error: error while loading package, class file '/Users/kvenkatesa/spark-1.6.1/assembly/target/scala-2.10/spark-assembly-1.6.1-hadoop2.2.0.jar(scala/reflect/package.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
error: error while loading package, class file '/Users/kvenkatesa/spark-1.6.1/assembly/target/scala-2.10/spark-assembly-1.6.1-hadoop2.2.0.jar(scala/package.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
error: error while loading Serializable, class file '/Users/kvenkatesa/spark-1.6.1/assembly/target/scala-2.10/spark-assembly-1.6.1-hadoop2.2.0.jar(scala/Serializable.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
error: error while loading Unit, class file '/Users/kvenkatesa/spark-1.6.1/assembly/target/scala-2.10/spark-assembly-1.6.1-hadoop2.2.0.jar(scala/Unit.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
res0: Either[org.apache.toree.magic.CellMagicOutput,org.apache.toree.magic.LineMagicOutput] = Right(())
16/03/30 16:07:36 [WARN] o.a.t.k.p.v.s.KernelOutputStream - Suppressing empty output: ''
I built spark 1.6.1 with hadoop 2.2.0 version since the error was looking for hadoop 2.2.0.
Thanks,
K
The text was updated successfully, but these errors were encountered:
Will lightning work with the Apache Toree Jupyter Kernel? Toree allows Jupyter the ability to run Spark commands. It works with both Scala and Python(PySpark).
Here is the Toree GitHub:
https://github.com/apache/incubator-toree/blob/master/README.md
When I add the lightning-scala Jar in Jupyter I get an error. Here is the command I run
%addJar file:/Users/kvenkatesa/dev/lightning-scala/target/scala-2.10/lightning-scala-assembly-0.1.0-SNAPSHOT.jar
I get the following error in the Jupyter log:
error: error while loading package, class file '/Users/kvenkatesa/spark-1.6.1/assembly/target/scala-2.10/spark-assembly-1.6.1-hadoop2.2.0.jar(scala/reflect/package.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
error: error while loading package, class file '/Users/kvenkatesa/spark-1.6.1/assembly/target/scala-2.10/spark-assembly-1.6.1-hadoop2.2.0.jar(scala/package.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
error: error while loading Serializable, class file '/Users/kvenkatesa/spark-1.6.1/assembly/target/scala-2.10/spark-assembly-1.6.1-hadoop2.2.0.jar(scala/Serializable.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
error: error while loading Unit, class file '/Users/kvenkatesa/spark-1.6.1/assembly/target/scala-2.10/spark-assembly-1.6.1-hadoop2.2.0.jar(scala/Unit.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
res0: Either[org.apache.toree.magic.CellMagicOutput,org.apache.toree.magic.LineMagicOutput] = Right(())
16/03/30 16:07:36 [WARN] o.a.t.k.p.v.s.KernelOutputStream - Suppressing empty output: ''
I built spark 1.6.1 with hadoop 2.2.0 version since the error was looking for hadoop 2.2.0.
Thanks,
K
The text was updated successfully, but these errors were encountered: