spark-instrumented-optimizer/sbin
Gengliang Wang 26c1b959cf
[SPARK-25711][CORE] Improve start-history-server.sh: show usage User-Friendly and remove deprecated options
## What changes were proposed in this pull request?

Currently, if we try run
```
./start-history-server.sh -h
```
We will get such error
```
java.io.FileNotFoundException: File -h does not exist
```

1. This is not User-Friendly.  For option `-h` or `--help`, it should be parsed correctly and show the usage of the class/script.
2. We can remove deprecated options for setting event log directory through command line options.

After fix, we can get following output:
```
Usage: ./sbin/start-history-server.sh [options]

Options:
  --properties-file FILE      Path to a custom Spark properties file.
                              Default is conf/spark-defaults.conf.

Configuration options can be set by setting the corresponding JVM system property.
History Server options are always available; additional options depend on the provider.

History Server options:

  spark.history.ui.port              Port where server will listen for connections
                                     (default 18080)
  spark.history.acls.enable          Whether to enable view acls for all applications
                                     (default false)
  spark.history.provider             Name of history provider class (defaults to
                                     file system-based provider)
  spark.history.retainedApplications Max number of application UIs to keep loaded in memory
                                     (default 50)
FsHistoryProvider options:

  spark.history.fs.logDirectory      Directory where app logs are stored
                                     (default: file:/tmp/spark-events)
  spark.history.fs.updateInterval    How often to reload log data from storage
                                     (in seconds, default: 10)

```

## How was this patch tested?

Manual test

Closes #22699 from gengliangwang/refactorSHSUsage.

Authored-by: Gengliang Wang <gengliang.wang@databricks.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
2018-10-13 13:34:31 -07:00
..
slaves.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
spark-config.sh [PYSPARK] Update py4j to version 0.10.7. 2018-05-09 10:47:35 -07:00
spark-daemon.sh [SPARK-20989][CORE] Fail to start multiple workers on one host if external shuffle service is enabled in standalone mode 2017-06-20 17:17:21 +08:00
spark-daemons.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
start-all.sh [SPARK-13521][BUILD] Remove reference to Tachyon in cluster & release scripts 2016-02-26 22:35:12 -08:00
start-history-server.sh [SPARK-25711][CORE] Improve start-history-server.sh: show usage User-Friendly and remove deprecated options 2018-10-13 13:34:31 -07:00
start-master.sh [SPARK-25712][CORE][MINOR] Improve usage message of start-master.sh and start-slave.sh 2018-10-12 12:42:34 -05:00
start-mesos-dispatcher.sh [SPARK-17944][DEPLOY] sbin/start-* scripts use of hostname -f fail with Solaris 2016-10-22 09:37:53 +01:00
start-mesos-shuffle-service.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
start-shuffle-service.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
start-slave.sh [SPARK-25712][CORE][MINOR] Improve usage message of start-master.sh and start-slave.sh 2018-10-12 12:42:34 -05:00
start-slaves.sh [SPARK-17944][DEPLOY] sbin/start-* scripts use of hostname -f fail with Solaris 2016-10-22 09:37:53 +01:00
start-thriftserver.sh [SPARK-17598][SQL][WEB UI] User-friendly name for Spark Thrift Server in web UI 2016-10-03 10:24:30 +01:00
stop-all.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
stop-history-server.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
stop-master.sh [SPARK-13521][BUILD] Remove reference to Tachyon in cluster & release scripts 2016-02-26 22:35:12 -08:00
stop-mesos-dispatcher.sh [SPARK-13414][MESOS] Allow multiple dispatchers to be launched. 2016-02-20 12:58:47 -08:00
stop-mesos-shuffle-service.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
stop-shuffle-service.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
stop-slave.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00
stop-slaves.sh [SPARK-13521][BUILD] Remove reference to Tachyon in cluster & release scripts 2016-02-26 22:35:12 -08:00
stop-thriftserver.sh [SPARK-2960][DEPLOY] Support executing Spark from symlinks (reopen) 2015-11-04 10:49:34 +00:00