[SPARK-35938][PYTHON] Add deprecation warning for Python 3.6
### What changes were proposed in this pull request? Add deprecation warning for Python 3.6. ### Why are the changes needed? According to https://endoflife.date/python, Python 3.6 will be EOL on 23 Dec, 2021. We should prepare for the deprecation of Python 3.6 support in Spark in advance. ### Does this PR introduce _any_ user-facing change? N/A. ### How was this patch tested? Manual tests. Closes #33139 from xinrong-databricks/deprecate3.6_warn. Authored-by: Xinrong Meng <xinrong.meng@databricks.com> Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
This commit is contained in:
parent
9e39415f3a
commit
5ad12611ec
|
@ -230,6 +230,14 @@ class SparkContext(object):
|
|||
self.pythonExec = os.environ.get("PYSPARK_PYTHON", 'python3')
|
||||
self.pythonVer = "%d.%d" % sys.version_info[:2]
|
||||
|
||||
if sys.version_info[:2] < (3, 7):
|
||||
with warnings.catch_warnings():
|
||||
warnings.simplefilter("once")
|
||||
warnings.warn(
|
||||
"Python 3.6 support is deprecated in Spark 3.2.",
|
||||
FutureWarning
|
||||
)
|
||||
|
||||
# Broadcast's __reduce__ method stores Broadcast instances here.
|
||||
# This allows other code to determine which Broadcast instances have
|
||||
# been pickled, so it can determine which Java broadcast objects to
|
||||
|
|
Loading…
Reference in a new issue