Patrick Wendell
1cfa7302ee
Preparing development version 1.4.2-SNAPSHOT
2015-06-22 22:21:31 -07:00
Patrick Wendell
d0a5560ce4
Preparing Spark release v1.4.1-rc1
2015-06-22 22:21:26 -07:00
Patrick Wendell
48d6830144
[BUILD] Preparing Spark release 1.4.1
2015-06-22 22:18:52 -07:00
Andrew Or
84da653192
[BUILD] Fix Maven build for Kinesis
...
A necessary dependency that is transitively referenced is not
provided, causing compilation failures in builds that provide
the kinesis-asl profile.
2015-06-03 20:47:53 -07:00
Patrick Wendell
ab713af564
Preparing development version 1.4.0-SNAPSHOT
2015-06-02 18:06:41 -07:00
Patrick Wendell
22596c534a
Preparing Spark release v1.4.0-rc4
2015-06-02 18:06:35 -07:00
Patrick Wendell
e3c35b217c
Preparing development version 1.4.0-SNAPSHOT
2015-06-02 17:01:15 -07:00
Patrick Wendell
a14fad11ef
Preparing Spark release v1.4.0-rc4
2015-06-02 17:01:10 -07:00
Patrick Wendell
92ccc5ba39
Preparing development version 1.4.0-SNAPSHOT
2015-06-02 14:02:19 -07:00
Patrick Wendell
d630f4d697
Preparing Spark release v1.4.0-rc4
2015-06-02 14:02:14 -07:00
Patrick Wendell
92a677891c
Preparing development version 1.4.0-SNAPSHOT
2015-06-02 08:41:15 -07:00
Patrick Wendell
48c506724a
Preparing Spark release v1.4.0-rc4
2015-06-02 08:41:10 -07:00
Reynold Xin
f63eab950b
[SPARK-3850] Trim trailing spaces for examples/streaming/yarn.
...
Author: Reynold Xin <rxin@databricks.com>
Closes #6530 from rxin/trim-whitespace-1 and squashes the following commits:
7b7b3a0 [Reynold Xin] Reset again.
dc14597 [Reynold Xin] Reset scalastyle.
cd556c4 [Reynold Xin] YARN, Kinesis, Flume.
4223fe1 [Reynold Xin] [SPARK-3850] Trim trailing spaces for examples/streaming.
(cherry picked from commit 564bc11e98
)
Signed-off-by: Reynold Xin <rxin@databricks.com>
2015-05-31 00:48:29 -07:00
Patrick Wendell
e549874c33
Preparing development version 1.4.0-SNAPSHOT
2015-05-29 13:07:07 -07:00
Patrick Wendell
dd109a8746
Preparing Spark release v1.4.0-rc3
2015-05-29 13:06:59 -07:00
Patrick Wendell
c68abaa34e
Preparing development version 1.4.0-SNAPSHOT
2015-05-29 12:15:18 -07:00
Patrick Wendell
fb60503ff2
Preparing Spark release v1.4.0-rc3
2015-05-29 12:15:13 -07:00
Patrick Wendell
6bf5a42084
Preparing development version 1.4.0-SNAPSHOT
2015-05-28 23:40:27 -07:00
Patrick Wendell
f2796816be
Preparing Spark release v1.4.0-rc3
2015-05-28 23:40:22 -07:00
Reynold Xin
55dc7a6933
[SPARK-7929] Turn whitespace checker on for more token types.
...
This is the last batch of changes to complete SPARK-7929.
Previous related PRs:
https://github.com/apache/spark/pull/6480
https://github.com/apache/spark/pull/6478
https://github.com/apache/spark/pull/6477
https://github.com/apache/spark/pull/6476
https://github.com/apache/spark/pull/6475
https://github.com/apache/spark/pull/6474
https://github.com/apache/spark/pull/6473
Author: Reynold Xin <rxin@databricks.com>
Closes #6487 from rxin/whitespace-lint and squashes the following commits:
b33d43d [Reynold Xin] [SPARK-7929] Turn whitespace checker on for more token types.
(cherry picked from commit 97a60cf75d
)
Signed-off-by: Reynold Xin <rxin@databricks.com>
2015-05-28 23:00:08 -07:00
Patrick Wendell
119c93af9c
Preparing development version 1.4.0-SNAPSHOT
2015-05-28 22:57:31 -07:00
Patrick Wendell
2d97d7a0aa
Preparing Spark release v1.4.0-rc3
2015-05-28 22:57:26 -07:00
Patrick Wendell
7c342bdd93
Preparing development version 1.4.0-SNAPSHOT
2015-05-27 22:36:30 -07:00
Patrick Wendell
4983dfc878
Preparing Spark release v1.4.0-rc3
2015-05-27 22:36:23 -07:00
Patrick Wendell
947d700ec8
Preparing development version 1.4.0-SNAPSHOT
2015-05-23 20:13:05 -07:00
Patrick Wendell
03fb26a3e5
Preparing Spark release v1.4.0-rc2
2015-05-23 20:13:00 -07:00
Patrick Wendell
f2f74b9b1a
Preparing development version 1.4.1-SNAPSHOT
2015-05-23 14:59:37 -07:00
Patrick Wendell
0da7396990
Preparing Spark release v1.4.0-rc2-test
2015-05-23 14:59:31 -07:00
Patrick Wendell
8da8caab17
Preparing development version 1.4.1-SNAPSHOT
2015-05-23 14:46:27 -07:00
Patrick Wendell
8f50218f38
Preparing Spark release 1.4.0-rc2-test
2015-05-23 14:46:23 -07:00
Tathagata Das
b928db4fe3
[SPARK-7838] [STREAMING] Set scope for kinesis stream
...
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #6369 from tdas/SPARK-7838 and squashes the following commits:
87d1c7f [Tathagata Das] Addressed comment
37775d8 [Tathagata Das] set scope for kinesis stream
(cherry picked from commit baa89838cc
)
Signed-off-by: Andrew Or <andrew@databricks.com>
2015-05-22 23:06:01 -07:00
Tathagata Das
130ec219aa
[SPARK-7788] Made KinesisReceiver.onStart() non-blocking
...
KinesisReceiver calls worker.run() which is a blocking call (while loop) as per source code of kinesis-client library - https://github.com/awslabs/amazon-kinesis-client/blob/v1.2.1/src/main/java/com/amazonaws/services/kinesis/clientlibrary/lib/worker/Worker.java .
This results in infinite loop while calling sparkStreamingContext.stop(stopSparkContext = false, stopGracefully = true) perhaps because ReceiverTracker is never able to register the receiver (it's receiverInfo field is a empty map) causing it to be stuck in infinite loop while waiting for running flag to be set to false.
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #6348 from tdas/SPARK-7788 and squashes the following commits:
2584683 [Tathagata Das] Added receiver id in thread name
6cf1cd4 [Tathagata Das] Made KinesisReceiver.onStart non-blocking
(cherry picked from commit 1c388a9985
)
Signed-off-by: Tathagata Das <tathagata.das1565@gmail.com>
2015-05-22 17:39:09 -07:00
Tathagata Das
777733e0e8
[SPARK-7722] [STREAMING] Added Kinesis to style checker
...
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #6325 from tdas/SPARK-7722 and squashes the following commits:
9ab35b2 [Tathagata Das] Fixed styles in Kinesis
(cherry picked from commit 311fab6f1b
)
Signed-off-by: Tathagata Das <tathagata.das1565@gmail.com>
2015-05-21 13:50:20 -07:00
Tathagata Das
21b1505695
[SPARK-7787] [STREAMING] Fix serialization issue of SerializableAWSCredentials
...
Lack of default constructor causes deserialization to fail. This occurs only when the AWS credentials are explicitly specified through KinesisUtils.
Author: Tathagata Das <tathagata.das1565@gmail.com>
Closes #6316 from tdas/SPARK-7787 and squashes the following commits:
248ca5c [Tathagata Das] Fixed serializability
(cherry picked from commit 4b7ff3092c
)
Signed-off-by: Tathagata Das <tathagata.das1565@gmail.com>
2015-05-21 11:39:42 -07:00
Patrick Wendell
9b37e32c55
Preparing development version 1.4.0-SNAPSHOT
2015-05-20 17:29:00 -07:00
Patrick Wendell
1e458e3553
Preparing Spark release rc-test
2015-05-20 17:28:55 -07:00
pwendell
8d66849862
Preparing development version 1.4.0-SNAPSHOT
2015-05-20 17:26:15 -07:00
pwendell
ae29aeaf8e
Preparing Spark release rc-test
2015-05-20 17:26:10 -07:00
jenkins
534c787b9f
Preparing development version 1.4.0-SNAPSHOT
2015-05-20 16:49:59 -07:00
jenkins
5f4d87f608
Preparing Spark release rc-test
2015-05-20 16:49:54 -07:00
Patrick Wendell
205ed15f29
Preparing development version 1.4.0-SNAPSHOT
2015-05-20 16:30:01 -07:00
Patrick Wendell
09a1c6231e
Preparing Spark release rc-test
2015-05-20 16:29:52 -07:00
Patrick Wendell
ac3197e1b9
Preparing development version 1.4.1-SNAPSHOT
2015-05-19 09:35:12 +00:00
Patrick Wendell
777a08166f
Preparing Spark release v1.4.0-rc1
2015-05-19 09:35:12 +00:00
Patrick Wendell
586ede6b32
Revert "Preparing Spark release v1.4.0-rc1"
...
This reverts commit 79fb01a3be
.
2015-05-19 02:27:14 -07:00
Patrick Wendell
e7309ec729
Revert "Preparing development version 1.4.1-SNAPSHOT"
...
This reverts commit a1d896b85b
.
2015-05-19 02:27:07 -07:00
Patrick Wendell
a1d896b85b
Preparing development version 1.4.1-SNAPSHOT
2015-05-19 07:13:24 +00:00
Patrick Wendell
79fb01a3be
Preparing Spark release v1.4.0-rc1
2015-05-19 07:13:24 +00:00
Patrick Wendell
b0c63d2413
Revert "Preparing Spark release v1.4.0-rc1"
...
This reverts commit 38ccef36c1
.
2015-05-19 00:10:39 -07:00
Patrick Wendell
198a186ad3
Revert "Preparing development version 1.4.1-SNAPSHOT"
...
This reverts commit 40190ce226
.
2015-05-19 00:10:37 -07:00