Henry Saputra
0386f42e38
Merge pull request #529 from hsaputra/cleanup_right_arrowop_scala
...
Change the ⇒ character (maybe from scalariform) to => in Scala code for style consistency
Looks like there are some ⇒ Unicode character (maybe from scalariform) in Scala code.
This PR is to change it to => to get some consistency on the Scala code.
If we want to use ⇒ as default we could use sbt plugin scalariform to make sure all Scala code has ⇒ instead of =>
And remove unused imports found in TwitterInputDStream.scala while I was there =)
Author: Henry Saputra <hsaputra@apache.org>
== Merge branch commits ==
commit 29c1771d346dff901b0b778f764e6b4409900234
Author: Henry Saputra <hsaputra@apache.org>
Date: Sat Feb 1 22:05:16 2014 -0800
Change the ⇒ character (maybe from scalariform) to => in Scala code for style consistency.
2014-02-02 21:51:17 -08:00
Tathagata Das
1f4718c480
Changed SparkConf to not be serializable. And also fixed unit-test log paths in log4j.properties of external modules.
2014-01-14 22:20:14 -08:00
Tathagata Das
4e497db8f3
Removed StreamingContext.registerInputStream and registerOutputStream - they were useless as InputDStream has been made to register itself. Also made DStream.register() private[streaming] - not useful to expose the confusing function. Updated a lot of documentation.
2014-01-13 23:23:46 -08:00
Tathagata Das
ffa1d38ef1
Fixed import formatting.
2014-01-12 22:27:07 -08:00
Tathagata Das
034f89aaab
Fixed persistence logic of WindowedDStream, and fixed default persistence level of input streams.
2014-01-12 19:02:27 -08:00
Tathagata Das
448aef6790
Moved DStream, DStreamCheckpointData and PairDStream from org.apache.spark.streaming to org.apache.spark.streaming.dstream.
2014-01-12 11:31:54 -08:00
Tathagata Das
c5921e5c61
Fixed bugs.
2014-01-12 01:12:08 -08:00
Patrick Wendell
4216178d5e
Merge pull request #373 from jerryshao/kafka-upgrade
...
Upgrade Kafka dependecy to 0.8.0 release version
2014-01-11 09:46:48 -08:00
Prabeesh K
645f5e83ee
Change clientId to random clientId
...
Returns a randomly generated client identifier based on the current user's login name and the system time.
2014-01-10 09:33:31 +05:30
jerryshao
dd7fd0c443
Upgrade Kafka dependecy to 0.8.0 release version
2014-01-10 08:56:11 +08:00
Tathagata Das
aa99f226a6
Removed XYZFunctions and added XYZUtils as a common Scala and Java interface for creating XYZ streams.
2014-01-07 01:56:15 -08:00
Tathagata Das
3b4c4c7f4d
Merge remote-tracking branch 'apache/master' into project-refactor
...
Conflicts:
examples/src/main/java/org/apache/spark/streaming/examples/JavaFlumeEventCount.java
streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala
streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala
streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java
streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala
streaming/src/test/scala/org/apache/spark/streaming/TestSuiteBase.scala
2014-01-06 03:05:52 -08:00
Tathagata Das
d0fd3b9ad2
Changed JavaStreamingContextWith*** to ***Function in streaming.api.java.*** package. Also fixed packages of Flume and MQTT tests.
2014-01-06 01:47:53 -08:00
Tathagata Das
87b915f221
Removed extra empty lines.
2013-12-31 00:42:10 -08:00
Tathagata Das
97630849ff
Added pom.xml for external projects and removed unnecessary dependencies and repositoris from other poms and sbt.
2013-12-31 00:28:57 -08:00
Tathagata Das
f4e4066191
Refactored kafka, flume, zeromq, mqtt as separate external projects, with their own self-contained scala API, java API, scala unit tests and java unit tests. Updated examples to use the external projects.
2013-12-30 11:13:24 -08:00
Tathagata Das
6e43039614
Refactored streaming project to separate out the twitter functionality.
2013-12-26 18:02:49 -08:00