f6a9a57a72
sbin/spark-daemon.sh used ps -p "$TARGET_PID" -o args= to figure out whether the process running with the expected PID is actually a Spark daemon. When running with a large classpath, the output of ps gets truncated and the check fails spuriously. This weakens the check to see if it's a java command (which is something we do in other parts of the script) rather than looking for the specific main class name. This means that SPARK-4832 might happen under a slightly broader range of circumstances (a java program happened to reuse the same PID), but it seems worthwhile compared to failing consistently with a large classpath. Author: Punya Biswal <pbiswal@palantir.com> Closes #5535 from punya/feature/SPARK-6952 and squashes the following commits: 7ea12d1 [Punya Biswal] Handle long args when detecting PID reuse |
||
---|---|---|
.. | ||
slaves.sh | ||
spark-config.sh | ||
spark-daemon.sh | ||
spark-daemons.sh | ||
start-all.sh | ||
start-history-server.sh | ||
start-master.sh | ||
start-slave.sh | ||
start-slaves.sh | ||
start-thriftserver.sh | ||
stop-all.sh | ||
stop-history-server.sh | ||
stop-master.sh | ||
stop-slave.sh | ||
stop-slaves.sh | ||
stop-thriftserver.sh |