Patrick Wendell
eafbe13459
Preparing development version 1.4.2-SNAPSHOT
2015-06-23 19:48:44 -07:00
Patrick Wendell
60e08e5075
Preparing Spark release v1.4.1-rc1
2015-06-23 19:48:39 -07:00
Patrick Wendell
1cfa7302ee
Preparing development version 1.4.2-SNAPSHOT
2015-06-22 22:21:31 -07:00
Patrick Wendell
d0a5560ce4
Preparing Spark release v1.4.1-rc1
2015-06-22 22:21:26 -07:00
Patrick Wendell
48d6830144
[BUILD] Preparing Spark release 1.4.1
2015-06-22 22:18:52 -07:00
WangTaoTheTonic
2846a357f3
[SPARK-8273] Driver hangs up when yarn shutdown in client mode
...
In client mode, if yarn was shut down with spark application running, the application will hang up after several retries(default: 30) because the exception throwed by YarnClientImpl could not be caught by upper level, we should exit in case that user can not be aware that.
The exception we wanna catch is [here](https://github.com/apache/hadoop/blob/branch-2.7.0/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/retry/RetryInvocationHandler.java#L122 ), and I try to fix it refer to [MR](https://github.com/apache/hadoop/blob/branch-2.7.0/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ClientServiceDelegate.java#L320 ).
Author: WangTaoTheTonic <wangtao111@huawei.com>
Closes #6717 from WangTaoTheTonic/SPARK-8273 and squashes the following commits:
28752d6 [WangTaoTheTonic] catch the throwed exception
2015-06-10 13:36:16 -07:00
linweizhong
a3afc2cbab
[SPARK-7705] [YARN] Cleanup of .sparkStaging directory fails if application is killed
...
As I have tested, if we cancel or kill the app then the final status may be undefined, killed or succeeded, so clean up staging directory when appMaster exit at any final application status.
Author: linweizhong <linweizhong@huawei.com>
Closes #6409 from Sephiroth-Lin/SPARK-7705 and squashes the following commits:
3a5a0a5 [linweizhong] Update
83dc274 [linweizhong] Update
923d44d [linweizhong] Update
0dd7c2d [linweizhong] Update
b76a102 [linweizhong] Update code style
7846b69 [linweizhong] Update
bd6cf0d [linweizhong] Refactor
aed9f18 [linweizhong] Clean up stagingDir when launch app on yarn
95595c3 [linweizhong] Cleanup of .sparkStaging directory when AppMaster exit at any final application status
(cherry picked from commit eacd4a929b
)
Signed-off-by: Sean Owen <sowen@cloudera.com>
2015-06-08 09:34:42 +01:00
Andrew Or
bfe74b34a6
[SPARK-7558] Demarcate tests in unit-tests.log (1.4)
...
This includes the following commits:
original: 9eb222c
hotfix1: 8c99793
hotfix2: a4f2412
scalastyle check: 609c492
---
Original patch #6441
Branch-1.3 patch #6602
Author: Andrew Or <andrew@databricks.com>
Closes #6598 from andrewor14/demarcate-tests-1.4 and squashes the following commits:
4c3c566 [Andrew Or] Merge branch 'branch-1.4' of github.com:apache/spark into demarcate-tests-1.4
e217b78 [Andrew Or] [SPARK-7558] Guard against direct uses of FunSuite / FunSuiteLike
46d4361 [Andrew Or] Various whitespace changes (minor)
3d9bf04 [Andrew Or] Make all test suites extend SparkFunSuite instead of FunSuite
eaa520e [Andrew Or] Fix tests?
b4d93de [Andrew Or] Fix tests
634a777 [Andrew Or] Fix log message
a932e8d [Andrew Or] Fix manual things that cannot be covered through automation
8bc355d [Andrew Or] Add core tests as dependencies in all modules
75d361f [Andrew Or] Introduce base abstract class for all test suites
2015-06-03 20:46:44 -07:00
zsxwing
306837e4e3
[SPARK-8001] [CORE] Make AsynchronousListenerBus.waitUntilEmpty throw TimeoutException if timeout
...
Some places forget to call `assert` to check the return value of `AsynchronousListenerBus.waitUntilEmpty`. Instead of adding `assert` in these places, I think it's better to make `AsynchronousListenerBus.waitUntilEmpty` throw `TimeoutException`.
Author: zsxwing <zsxwing@gmail.com>
Closes #6550 from zsxwing/SPARK-8001 and squashes the following commits:
607674a [zsxwing] Make AsynchronousListenerBus.waitUntilEmpty throw TimeoutException if timeout
(cherry picked from commit 1d8669f15c
)
Signed-off-by: Andrew Or <andrew@databricks.com>
2015-06-03 15:03:15 -07:00
Patrick Wendell
ab713af564
Preparing development version 1.4.0-SNAPSHOT
2015-06-02 18:06:41 -07:00
Patrick Wendell
22596c534a
Preparing Spark release v1.4.0-rc4
2015-06-02 18:06:35 -07:00
Patrick Wendell
e3c35b217c
Preparing development version 1.4.0-SNAPSHOT
2015-06-02 17:01:15 -07:00
Patrick Wendell
a14fad11ef
Preparing Spark release v1.4.0-rc4
2015-06-02 17:01:10 -07:00
Patrick Wendell
92ccc5ba39
Preparing development version 1.4.0-SNAPSHOT
2015-06-02 14:02:19 -07:00
Patrick Wendell
d630f4d697
Preparing Spark release v1.4.0-rc4
2015-06-02 14:02:14 -07:00
Patrick Wendell
92a677891c
Preparing development version 1.4.0-SNAPSHOT
2015-06-02 08:41:15 -07:00
Patrick Wendell
48c506724a
Preparing Spark release v1.4.0-rc4
2015-06-02 08:41:10 -07:00
Reynold Xin
f63eab950b
[SPARK-3850] Trim trailing spaces for examples/streaming/yarn.
...
Author: Reynold Xin <rxin@databricks.com>
Closes #6530 from rxin/trim-whitespace-1 and squashes the following commits:
7b7b3a0 [Reynold Xin] Reset again.
dc14597 [Reynold Xin] Reset scalastyle.
cd556c4 [Reynold Xin] YARN, Kinesis, Flume.
4223fe1 [Reynold Xin] [SPARK-3850] Trim trailing spaces for examples/streaming.
(cherry picked from commit 564bc11e98
)
Signed-off-by: Reynold Xin <rxin@databricks.com>
2015-05-31 00:48:29 -07:00
Patrick Wendell
e549874c33
Preparing development version 1.4.0-SNAPSHOT
2015-05-29 13:07:07 -07:00
Patrick Wendell
dd109a8746
Preparing Spark release v1.4.0-rc3
2015-05-29 13:06:59 -07:00
Patrick Wendell
c68abaa34e
Preparing development version 1.4.0-SNAPSHOT
2015-05-29 12:15:18 -07:00
Patrick Wendell
fb60503ff2
Preparing Spark release v1.4.0-rc3
2015-05-29 12:15:13 -07:00
Patrick Wendell
6bf5a42084
Preparing development version 1.4.0-SNAPSHOT
2015-05-28 23:40:27 -07:00
Patrick Wendell
f2796816be
Preparing Spark release v1.4.0-rc3
2015-05-28 23:40:22 -07:00
Reynold Xin
55dc7a6933
[SPARK-7929] Turn whitespace checker on for more token types.
...
This is the last batch of changes to complete SPARK-7929.
Previous related PRs:
https://github.com/apache/spark/pull/6480
https://github.com/apache/spark/pull/6478
https://github.com/apache/spark/pull/6477
https://github.com/apache/spark/pull/6476
https://github.com/apache/spark/pull/6475
https://github.com/apache/spark/pull/6474
https://github.com/apache/spark/pull/6473
Author: Reynold Xin <rxin@databricks.com>
Closes #6487 from rxin/whitespace-lint and squashes the following commits:
b33d43d [Reynold Xin] [SPARK-7929] Turn whitespace checker on for more token types.
(cherry picked from commit 97a60cf75d
)
Signed-off-by: Reynold Xin <rxin@databricks.com>
2015-05-28 23:00:08 -07:00
Patrick Wendell
119c93af9c
Preparing development version 1.4.0-SNAPSHOT
2015-05-28 22:57:31 -07:00
Patrick Wendell
2d97d7a0aa
Preparing Spark release v1.4.0-rc3
2015-05-28 22:57:26 -07:00
Patrick Wendell
7c342bdd93
Preparing development version 1.4.0-SNAPSHOT
2015-05-27 22:36:30 -07:00
Patrick Wendell
4983dfc878
Preparing Spark release v1.4.0-rc3
2015-05-27 22:36:23 -07:00
Patrick Wendell
947d700ec8
Preparing development version 1.4.0-SNAPSHOT
2015-05-23 20:13:05 -07:00
Patrick Wendell
03fb26a3e5
Preparing Spark release v1.4.0-rc2
2015-05-23 20:13:00 -07:00
Patrick Wendell
f2f74b9b1a
Preparing development version 1.4.1-SNAPSHOT
2015-05-23 14:59:37 -07:00
Patrick Wendell
0da7396990
Preparing Spark release v1.4.0-rc2-test
2015-05-23 14:59:31 -07:00
Patrick Wendell
8da8caab17
Preparing development version 1.4.1-SNAPSHOT
2015-05-23 14:46:27 -07:00
Patrick Wendell
8f50218f38
Preparing Spark release 1.4.0-rc2-test
2015-05-23 14:46:23 -07:00
Patrick Wendell
9b37e32c55
Preparing development version 1.4.0-SNAPSHOT
2015-05-20 17:29:00 -07:00
Patrick Wendell
1e458e3553
Preparing Spark release rc-test
2015-05-20 17:28:55 -07:00
pwendell
8d66849862
Preparing development version 1.4.0-SNAPSHOT
2015-05-20 17:26:15 -07:00
pwendell
ae29aeaf8e
Preparing Spark release rc-test
2015-05-20 17:26:10 -07:00
jenkins
534c787b9f
Preparing development version 1.4.0-SNAPSHOT
2015-05-20 16:49:59 -07:00
jenkins
5f4d87f608
Preparing Spark release rc-test
2015-05-20 16:49:54 -07:00
Patrick Wendell
205ed15f29
Preparing development version 1.4.0-SNAPSHOT
2015-05-20 16:30:01 -07:00
Patrick Wendell
09a1c6231e
Preparing Spark release rc-test
2015-05-20 16:29:52 -07:00
Patrick Wendell
ac3197e1b9
Preparing development version 1.4.1-SNAPSHOT
2015-05-19 09:35:12 +00:00
Patrick Wendell
777a08166f
Preparing Spark release v1.4.0-rc1
2015-05-19 09:35:12 +00:00
Patrick Wendell
586ede6b32
Revert "Preparing Spark release v1.4.0-rc1"
...
This reverts commit 79fb01a3be
.
2015-05-19 02:27:14 -07:00
Patrick Wendell
e7309ec729
Revert "Preparing development version 1.4.1-SNAPSHOT"
...
This reverts commit a1d896b85b
.
2015-05-19 02:27:07 -07:00
Patrick Wendell
a1d896b85b
Preparing development version 1.4.1-SNAPSHOT
2015-05-19 07:13:24 +00:00
Patrick Wendell
79fb01a3be
Preparing Spark release v1.4.0-rc1
2015-05-19 07:13:24 +00:00
Patrick Wendell
b0c63d2413
Revert "Preparing Spark release v1.4.0-rc1"
...
This reverts commit 38ccef36c1
.
2015-05-19 00:10:39 -07:00