ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/python/pyspark/sql
History
Michael Nazario 1c5b19827a [SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict 
This PR makes the types module in `pyspark/sql/types` work with pylint static analysis by removing the dynamic naming of the `pyspark/sql/_types` module to `pyspark/sql/types`.

Tests are now loaded using `$PYSPARK_DRIVER_PYTHON -m module` rather than `$PYSPARK_DRIVER_PYTHON module.py`. The old method adds the location of `module.py` to `sys.path`, so this change prevents accidental use of relative paths in Python.

Author: Michael Nazario <mnazario@palantir.com>

Closes #6439 from mnazario/feature/SPARK-7899 and squashes the following commits:

366ef30 [Michael Nazario] Remove hack on random.py
bb8b04d [Michael Nazario] Make doctests consistent with other tests
6ee4f75 [Michael Nazario] Change test scripts to use "-m"
673528f [Michael Nazario] Move _types back to types
2015-05-29 14:13:44 -07:00
..
__init__.py [SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict 2015-05-29 14:13:44 -07:00
column.py [SPARK-7322, SPARK-7836, SPARK-7822][SQL] DataFrame window function related updates 2015-05-23 08:30:05 -07:00
context.py [SPARK-7322, SPARK-7836, SPARK-7822][SQL] DataFrame window function related updates 2015-05-23 08:30:05 -07:00
dataframe.py [SPARK-7840] add insertInto() to Writer 2015-05-23 09:07:14 -07:00
functions.py [SPARK-7322, SPARK-7836, SPARK-7822][SQL] DataFrame window function related updates 2015-05-23 08:30:05 -07:00
group.py [SPARK-7322, SPARK-7836, SPARK-7822][SQL] DataFrame window function related updates 2015-05-23 08:30:05 -07:00
readwriter.py [SPARK-7840] add insertInto() to Writer 2015-05-23 09:07:14 -07:00
tests.py [SPARK-7322, SPARK-7836, SPARK-7822][SQL] DataFrame window function related updates 2015-05-23 08:30:05 -07:00
types.py [SPARK-7899] [PYSPARK] Fix Python 3 pyspark/sql/types module conflict 2015-05-29 14:13:44 -07:00
window.py [SPARK-7322, SPARK-7836, SPARK-7822][SQL] DataFrame window function related updates 2015-05-23 08:30:05 -07:00