spark-instrumented-optimizer/python/pyspark/pandas/tests
Xinrong Meng 4d2b559d92 [SPARK-34999][PYTHON] Consolidate PySpark testing utils
### What changes were proposed in this pull request?
Consolidate PySpark testing utils by removing `python/pyspark/pandas/testing`, and then creating a file `pandasutils` under `python/pyspark/testing` for test utilities used in `pyspark/pandas`.

### Why are the changes needed?

`python/pyspark/pandas/testing` hold test utilites for pandas-on-spark, and `python/pyspark/testing` contain test utilities for pyspark. Consolidating them makes code cleaner and easier to maintain.

Updated import statements are as shown below:
- from pyspark.testing.sqlutils import SQLTestUtils
- from pyspark.testing.pandasutils import PandasOnSparkTestCase, TestUtils
(PandasOnSparkTestCase is the original ReusedSQLTestCase in `python/pyspark/pandas/testing/utils.py`)

Minor improvements include:
- Usage of missing library's requirement_message
- `except ImportError` rather than `except`
- import pyspark.pandas alias as `ps` rather than `pp`

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Unit tests under python/pyspark/pandas/tests.

Closes #32177 from xinrong-databricks/port.merge_utils.

Authored-by: Xinrong Meng <xinrong.meng@databricks.com>
Signed-off-by: Takuya UESHIN <ueshin@databricks.com>
2021-04-22 13:07:35 -07:00
..
indexes [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
plot [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
__init__.py [SPARK-34886][PYTHON] Port/integrate Koalas DataFrame unit test into PySpark 2021-04-09 15:48:13 +09:00
test_categorical.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_config.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_csv.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_dataframe.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_dataframe_conversion.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_dataframe_spark_io.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_default_index.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_expanding.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_extension.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_frame_spark.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_groupby.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_indexing.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_indexops_spark.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_internal.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_namespace.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_numpy_compat.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_ops_on_diff_frames.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_ops_on_diff_frames_groupby.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_ops_on_diff_frames_groupby_expanding.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_ops_on_diff_frames_groupby_rolling.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_repr.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_reshape.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_rolling.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_series.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_series_conversion.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_series_datetime.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_series_string.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_sql.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_stats.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_typedef.py [SPARK-35071][PYTHON] Rename Koalas to pandas-on-Spark in main codes 2021-04-15 12:48:59 +09:00
test_utils.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00
test_window.py [SPARK-34999][PYTHON] Consolidate PySpark testing utils 2021-04-22 13:07:35 -07:00