ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/graphx/src
History
luluorta 9b225ac307 [SPARK-2823][GraphX]fix GraphX EdgeRDD zipPartitions 
If the users set “spark.default.parallelism” and the value is different with the EdgeRDD partition number, GraphX jobs will throw:
java.lang.IllegalArgumentException: Can't zip RDDs with unequal numbers of partitions

Author: luluorta <luluorta@gmail.com>

Closes #1763 from luluorta/fix-graph-zip and squashes the following commits:

8338961 [luluorta] fix GraphX EdgeRDD zipPartitions
2014-09-02 19:26:27 -07:00
..
main/scala/org/apache/spark/graphx [SPARK-2823][GraphX]fix GraphX EdgeRDD zipPartitions 2014-09-02 19:26:27 -07:00
test [SPARK-2823][GraphX]fix GraphX EdgeRDD zipPartitions 2014-09-02 19:26:27 -07:00