ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/python/pyspark/mllib
History
Michael Nazario a76c2e128b [SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict 
This PR makes the types module in `pyspark/sql/types` work with pylint static analysis by removing the dynamic naming of the `pyspark/sql/_types` module to `pyspark/sql/types`.

Tests are now loaded using `$PYSPARK_DRIVER_PYTHON -m module` rather than `$PYSPARK_DRIVER_PYTHON module.py`. The old method adds the location of `module.py` to `sys.path`, so this change prevents accidental use of relative paths in Python.

Author: Michael Nazario <mnazario@palantir.com>

Closes #6439 from mnazario/feature/SPARK-7899 and squashes the following commits:

366ef30 [Michael Nazario] Remove hack on random.py
bb8b04d [Michael Nazario] Make doctests consistent with other tests
6ee4f75 [Michael Nazario] Change test scripts to use "-m"
673528f [Michael Nazario] Move _types back to types
2015-06-01 16:56:04 -07:00
..
stat [SPARK-4897] [PySpark] Python 3 support 2015-04-16 16:20:57 -07:00
__init__.py [SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict 2015-06-01 16:56:04 -07:00
classification.py [SPARK-6953] [PySpark] speed up python tests 2015-04-21 17:49:55 -07:00
clustering.py [SPARK-7651] [MLLIB] [PYSPARK] GMM predict, predictSoft should raise error on bad input 2015-05-15 10:43:26 -07:00
common.py [SPARK-7922] [MLLIB] use DataFrames for user/item factors in ALSModel 2015-05-28 22:38:46 -07:00
evaluation.py [SPARK-7918] [MLLIB] MLlib Python doc parity check for evaluation and feature 2015-05-30 16:24:26 -07:00
feature.py [SPARK-7918] [MLLIB] MLlib Python doc parity check for evaluation and feature 2015-05-30 16:24:26 -07:00
fpm.py [SPARK-6657] [PYSPARK] Fix doc warnings 2015-05-18 08:35:24 -07:00
linalg.py [SPARK-7328] [MLLIB] [PYSPARK] Pyspark.mllib.linalg.Vectors: Missing items 2015-05-07 14:02:18 -07:00
random.py [SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict 2015-06-01 16:56:04 -07:00
recommendation.py [SPARK-6257] [PYSPARK] [MLLIB] MLlib API missing items in Recommendation 2015-04-30 23:51:00 -07:00
regression.py [SPARK-6267] [MLLIB] Python API for IsotonicRegression 2015-05-05 22:57:46 -07:00
tests.py [SPARK-7328] [MLLIB] [PYSPARK] Pyspark.mllib.linalg.Vectors: Missing items 2015-05-07 14:02:18 -07:00
tree.py [SPARK-6953] [PySpark] speed up python tests 2015-04-21 17:49:55 -07:00
util.py [SPARK-4897] [PySpark] Python 3 support 2015-04-16 16:20:57 -07:00