388f5a0635
## What changes were proposed in this pull request? Implement BarrierTaskContext.barrier(), to support global sync between all the tasks in a barrier stage. The function set a global barrier and waits until all tasks in this stage hit this barrier. Similar to MPI_Barrier function in MPI, the barrier() function call blocks until all tasks in the same stage have reached this routine. The global sync shall finish immediately once all tasks in the same barrier stage reaches the same barrier. This PR implements BarrierTaskContext.barrier() based on netty-based RPC client, introduces new `BarrierCoordinator` and new `BarrierCoordinatorMessage`, and new config to handle timeout issue. ## How was this patch tested? Add `BarrierTaskContextSuite` to test `BarrierTaskContext.barrier()` Closes #21898 from jiangxb1987/taskcontext.barrier. Authored-by: Xingbo Jiang <xingbo.jiang@databricks.com> Signed-off-by: Wenchen Fan <wenchen@databricks.com> |
||
|---|---|---|
| .. | ||
| src | ||
| pom.xml | ||