800590035c
### What changes were proposed in this pull request? `TaskContextTestsWithWorkerReuse.test_task_context_correct_with_python_worker_reuse` can be flaky and fails sometimes: ``` ====================================================================== ERROR [1.798s]: test_task_context_correct_with_python_worker_reuse (pyspark.tests.test_taskcontext.TaskContextTestsWithWorkerReuse) ... test_task_context_correct_with_python_worker_reuse self.assertTrue(pid in worker_pids) AssertionError: False is not true ---------------------------------------------------------------------- ``` I suspect that the Python worker was killed for whatever reason and new attempt created a new Python worker. This PR fixes the flakiness simply by retrying the test case. ### Why are the changes needed? To make the tests more robust. ### Does this PR introduce _any_ user-facing change? No, dev-only. ### How was this patch tested? Manually tested it by controlling the conditions manually in the test codes. Closes #31723 from HyukjinKwon/SPARK-34604. Authored-by: HyukjinKwon <gurwls223@apache.org> Signed-off-by: HyukjinKwon <gurwls223@apache.org> |
||
---|---|---|
.. | ||
__init__.py | ||
test_appsubmit.py | ||
test_broadcast.py | ||
test_conf.py | ||
test_context.py | ||
test_daemon.py | ||
test_install_spark.py | ||
test_join.py | ||
test_pin_thread.py | ||
test_profiler.py | ||
test_rdd.py | ||
test_rddbarrier.py | ||
test_readwrite.py | ||
test_serializers.py | ||
test_shuffle.py | ||
test_taskcontext.py | ||
test_util.py | ||
test_worker.py |