ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/python/pyspark/sql
History
Takuya UESHIN 13190a4f60 [SPARK-22874][PYSPARK][SQL] Modify checking pandas version to use LooseVersion. 
## What changes were proposed in this pull request?

Currently we check pandas version by capturing if `ImportError` for the specific imports is raised or not but we can compare `LooseVersion` of the version strings as the same as we're checking pyarrow version.

## How was this patch tested?

Existing tests.

Author: Takuya UESHIN <ueshin@databricks.com>

Closes #20054 from ueshin/issues/SPARK-22874.
2017-12-22 20:09:51 +09:00
..
__init__.py [SPARK-22369][PYTHON][DOCS] Exposes catalog API documentation in PySpark 2017-11-02 15:22:52 +01:00
catalog.py [SPARK-22409] Introduce function type argument in pandas_udf 2017-11-17 16:43:08 +01:00
column.py [SPARK-19165][PYTHON][SQL] PySpark APIs using columns as arguments should validate input types for column 2017-08-24 20:29:03 +09:00
conf.py [SPARK-15464][ML][MLLIB][SQL][TESTS] Replace SQLContext and SparkContext with SparkSession using builder pattern in python test code 2016-05-23 18:14:48 -07:00
context.py [SPARK-20586][SQL] Add deterministic to ScalaUDF 2017-07-25 17:19:44 -07:00
dataframe.py [SPARK-22874][PYSPARK][SQL] Modify checking pandas version to use LooseVersion. 2017-12-22 20:09:51 +09:00
functions.py [SPARK-22324][SQL][PYTHON] Upgrade Arrow to 0.8.0 2017-12-21 20:43:56 +09:00
group.py [SPARK-22324][SQL][PYTHON] Upgrade Arrow to 0.8.0 2017-12-21 20:43:56 +09:00
readwriter.py [SPARK-16496][SQL] Add wholetext as option for reading text in SQL. 2017-12-14 11:19:34 -08:00
session.py [SPARK-22874][PYSPARK][SQL] Modify checking pandas version to use LooseVersion. 2017-12-22 20:09:51 +09:00
streaming.py [SPARK-22781][SS] Support creating streaming dataset with ORC files 2017-12-19 23:50:06 -08:00
tests.py [SPARK-22874][PYSPARK][SQL] Modify checking pandas version to use LooseVersion. 2017-12-22 20:09:51 +09:00
types.py [SPARK-22874][PYSPARK][SQL] Modify checking pandas version to use LooseVersion. 2017-12-22 20:09:51 +09:00
udf.py [SPARK-22874][PYSPARK][SQL] Modify checking pandas version to use LooseVersion. 2017-12-22 20:09:51 +09:00
utils.py [SPARK-22874][PYSPARK][SQL] Modify checking pandas version to use LooseVersion. 2017-12-22 20:09:51 +09:00
window.py [SPARK-18690][PYTHON][SQL] Backward compatibility of unbounded frames 2016-12-02 17:39:28 -08:00