Contrib

Contrib Datalayer.

Apache Zeppelin

Multi User

Misc

Zeppelin on K8S

kubectl delete -f k8s/zeppelin-k8s.yaml
kubectl create -f k8s/zeppelin-k8s.yaml
kubectl get svc --selector=app=zeppelin-k8-svc -o jsonpath='{.items[0].spec.ports}'
export POD=$(kubectl get pods -n default -l "app=zeppelin-k8s" -o jsonpath="{.items[0].metadata.name}")
kubectl exec -it $POD -- bash
kubectl get svc spark-resource-staging-service -o jsonpath='{.spec.clusterIP}'
kubectl expose pod $HOSTNAME --port=$PORT --target-port=$PORT --name=zeppelin-interpreter-spark-$PORT
CALLBACK_HOST=$(kubectl get -o template svc zeppelin-interpreter-spark-$PORT --template=)

Driver Memory

interpreter.sh:       INTERPRETER_RUN_COMMAND+=' '` echo ${SPARK_SUBMIT} --driver-memory 60g --driver-java-options \"${JAVA_INTP_OPTS}\" --class ${ZEPPELIN_SERVER} --driver-class-path \"${ZEPPELIN_INTP_CLASSPATH_OVERRIDES}:${ZEPPELIN_INTP_CLASSPATH}\" ${SPARK_SUBMIT_OPTIONS} --proxy-user ${ZEPPELIN_IMPERSONATE_USER} ${SPARK_APP_JAR} ${PORT}`
interpreter.sh:       INTERPRETER_RUN_COMMAND+=' '` echo ${SPARK_SUBMIT} --driver-memory 40g --driver-java-options \"${JAVA_INTP_OPTS}\" --class ${ZEPPELIN_SERVER} --driver-class-path \"${ZEPPELIN_INTP_CLASSPATH_OVERRIDES}:${ZEPPELIN_INTP_CLASSPATH}\" ${SPARK_SUBMIT_OPTIONS} ${SPARK_APP_JAR} ${PORT}`

Info

./bin/interpreter.sh -d /src/zeppelin/interpreter/md -p 40030 -l .//local-repo/2BXKBTJ9W
export ZEPPELIN_MEM="-Xdebug -Xnoagent -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=5005"
-agentlib:jdwp=transport=dt_socket,server=y,suspend=n,address=5005

Contributions

DESCRIPTION ISSUE REPOSITORY DOC PR STATUS
Add support to run Spark interpreter on a Kubernetes cluster ZEPPELIN-3020 banzaicloud:zeppelin/inject-services #2637 OPEN
Inject Services ZEPPELIN-1354 datalayer:spitfire/inject-services #1361 OPEN
Support Spell as Display ZEPPELIN-2359 datalayer:spitfire/ZEPPELIN-2359 #1361 OPEN
Note management per user ZEPPELIN-1339 datalayer:spitfire/multiuser #1390 OPEN
Multiple simultaneous on a single WEB server ZEPPELIN-1000 datalayer:spitfire/multiuser #1390 OPEN
Local or Remote Interpreter by Configuration datalayer:spitfire/remote-interpreter-config #1385 OPEN
Jersey instead of CXF for better JSON REST ZEPPELIN-903 datalayer:spitfire/jersey2 #932 MERGED on 02 Jun 2017
commons-exec should be in compile scope of zeppelin-server ZEPPELIN-904 datalayer:spitfire/commons-exec-compile-scope #931 MERGED on 04 Jun 2016
Upgrade to Jetty 9 ZEPPELIN-798 zeppelin-k8s/jetty9 #831 MERGED on 28 Apr 2016
Interpeter settings update is broken ZEPPELIN-725 datalayer:spitfire/ZEPPELIN-725... #768 MERGED on 09 Mar 2016
SparkR support ZEPPELIN-156 datalayer:spitfire/rscala-z Documentation #702 MERGED on 05 Apr 2016
Allow to prepend a CLASSPATH with a CLASSPATH_OVERRIDES environment variable ZEPPELIN-383 datalayer:spitfire/ZEPPELIN-383... #412 MERGED on 09 Nov 2015
Changing the context root of the GUI ZEPPELIN-337 datalayer:spitfire/ZEPPELIN-337... #429 MERGED on 19 Nov 2015
Helium load.js should reside in subfolder ZEPPELIN-2235 datalayer:spitfire/ZEPPELIN-2235 #2226 #429 NOT MERGED
DESCRIPTION ISSUE REPOSITORY DOC PR STATUS
Pod-cidr to Podnode Mapping Understanding of PodCIDRToNodeMapping.resolve behavior
Support multiple hdfs datanodes per k8s node?
PR NOT YET OPENED
Kerberos (SPNEGO) Support ZEPPELIN-193 PR NOT YET OPENED
Zeppelin should work in a Kerberos enabled cluster ZEPPELIN-446 datalayer:spitfire/spark-multiuser-kerberos PR NOT YET OPENED
Run zeppelin interpreter process as web front end user ZEPPELIN-1320 PR NOT YET OPENED
Summary function in R does not display proper output ZEPPELIN-1230 PR NOT YET OPENED
Run remote interpreter process in remote machine ZEPPELIN-1377 PR NOT YET OPENED
Add/Override Interpreter properties with value appended to the magic keywords in a paragraph ZEPPELIN-668 PR NOT YET OPENED
Content API datalayer:spitfire/content-api JIRA NOT YET OPENED
Add math formula support for Markdown interpreter ZEPPELIN-777 PR NOT YET OPENED
Add zeppelin.war config in template zeppelin-site (sh and xml) JIRA NOT YET OPENED
Make Zeppelin Embeddable JIRA NOT YET OPENED