Xianyang Liu 0a7095156b [SPARK-29499][CORE][PYSPARK] Add mapPartitionsWithIndex for RDDBarrier ... ### What changes were proposed in this pull request? Add mapPartitionsWithIndex for RDDBarrier. ### Why are the changes needed? There is only one method in `RDDBarrier`. We often use the partition index as a label for the current partition. We need to get the index from `TaskContext` index in the method of `mapPartitions` which is not convenient. ### Does this PR introduce any user-facing change? No ### How was this patch tested? New UT. Closes #26148 from ConeyLiu/barrier-index. Authored-by: Xianyang Liu <xianyang.liu@intel.com> Signed-off-by: Xingbo Jiang <xingbo.jiang@databricks.com>		2019-10-23 13:46:09 +02:00
..
benchmarks	[SPARK-29434][CORE] Improve the MapStatuses Serialization Performance	2019-10-20 13:56:23 -07:00
src	[SPARK-29499][CORE][PYSPARK] Add mapPartitionsWithIndex for RDDBarrier	2019-10-23 13:46:09 +02:00
pom.xml	[SPARK-29296][BUILD][CORE] Remove use of .par to make 2.13 support easier; add scala-2.13 profile to enable pulling in par collections library separately, for the future	2019-10-03 08:56:08 -05:00