diff options
| author | Amir Sanjar <afsanjar@gmail.com> | 2017-04-12 10:01:43 -0500 |
|---|---|---|
| committer | Amir Sanjar <afsanjar@gmail.com> | 2017-04-12 10:04:30 -0500 |
| commit | da2c4292f081960653739d9db28d84930189be9c (patch) | |
| tree | 0e491c28256f1f7af50180d30543dd814a270483 /bigtop-packages | |
| parent | b00ac093634437e749561c8837179d13d95fda91 (diff) | |
BIGTOP-2738: Fix spark-worker deamon not starting
Signed-off-by: Amir Sanjar <afsanjar@gmail.com>
Diffstat (limited to 'bigtop-packages')
| -rwxr-xr-x | bigtop-packages/src/common/spark/spark-env.sh | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/bigtop-packages/src/common/spark/spark-env.sh b/bigtop-packages/src/common/spark/spark-env.sh index 885aed13..f772ef1a 100755 --- a/bigtop-packages/src/common/spark/spark-env.sh +++ b/bigtop-packages/src/common/spark/spark-env.sh @@ -39,5 +39,5 @@ export SPARK_MASTER_WEBUI_PORT=18080 export SPARK_WORKER_DIR=${SPARK_WORKER_DIR:-/var/run/spark/work} export SPARK_WORKER_PORT=7078 export SPARK_WORKER_WEBUI_PORT=18081 - +export SPARK_MASTER_URL=spark://$STANDALONE_SPARK_MASTER_HOST:$SPARK_MASTER_PORT export SPARK_HISTORY_OPTS="$SPARK_HISTORY_OPTS -Dspark.history.fs.logDirectory=hdfs:///var/log/spark/apps -Dspark.history.ui.port=18082" |