ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/python/pyspark/pandas
History
itholic 5268904742 [SPARK-36506][PYTHON] Improve test coverage for series.py and indexes/*.py 
### What changes were proposed in this pull request?

This PR proposes improving test coverage for pandas-on-Spark Series & Index code base, which is written in `series.py` and `indexes/*.py` separately.

This PR did the following to improve coverage:
- Add unittest for untested code
- Fix unittest which is not tested properly
- Remove unused code

**NOTE**: This PR is not only include the test-only update, for example it includes the new warning for `__xor__`, `__and__`, `__or__`.

### Why are the changes needed?

To make the project healthier by improving coverage.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Unittest.

Closes #33844 from itholic/SPARK-36506.

Authored-by: itholic <haejoon.lee@databricks.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
2021-09-23 14:23:52 +09:00
..
data_type_ops [SPARK-36653][PYTHON] Implement Series.__xor__ and Series.__rxor__ 2021-09-13 15:09:22 -07:00
indexes [SPARK-36506][PYTHON] Improve test coverage for series.py and indexes/*.py 2021-09-23 14:23:52 +09:00
missing [SPARK-36689][PYTHON] Cleanup the deprecated APIs and raise proper warning message 2021-09-09 19:50:29 +09:00
plot [SPARK-35344][PYTHON] Support creating a Column of numpy literals in pandas API on Spark 2021-06-28 19:03:42 -07:00
spark [SPARK-35859][PYTHON] Cleanup type hints in pandas-on-Spark 2021-06-29 10:52:24 -07:00
tests [SPARK-36506][PYTHON] Improve test coverage for series.py and indexes/*.py 2021-09-23 14:23:52 +09:00
typedef [SPARK-36708][PYTHON] Support numpy.typing for annotating ArrayType in pandas API on Spark 2021-09-23 10:50:10 +09:00
usage_logging [SPARK-36470][PYTHON] Implement CategoricalIndex.map and DatetimeIndex.map 2021-08-23 10:08:40 +09:00
__init__.py [SPARK-36253][PYTHON][DOCS] Add versionadded to the top of pandas-on-Spark package 2021-07-22 14:21:43 +09:00
_typing.py [SPARK-35944][PYTHON] Introduce Name and Label type aliases 2021-07-01 09:40:07 +09:00
accessors.py [SPARK-36710][PYTHON] Support new typing syntax in function apply APIs in pandas API on Spark 2021-09-20 10:37:06 +09:00
base.py [SPARK-36762][PYTHON] Fix Series.isin when Series has NaN values 2021-09-17 17:48:15 -07:00
categorical.py [SPARK-36368][PYTHON] Fix CategoricalOps.astype to follow pandas 1.3 2021-08-18 11:38:59 -07:00
config.py [SPARK-36748][PYTHON] Introduce the 'compute.isin_limit' option 2021-09-14 11:37:35 +09:00
datetimes.py [SPARK-36625][SPARK-36661][PYTHON] Support TimestampNTZ in pandas API on Spark 2021-09-09 09:57:38 +09:00
exceptions.py [SPARK-35465][PYTHON] Set up the mypy configuration to enable disallow_untyped_defs check for pandas APIs on Spark module 2021-05-21 11:03:35 -07:00
extensions.py [SPARK-35859][PYTHON] Cleanup type hints in pandas-on-Spark 2021-06-29 10:52:24 -07:00
frame.py [SPARK-36769][PYTHON] Improve filter of single-indexed DataFrame 2021-09-21 10:20:15 -07:00
generic.py [SPARK-36350][PYTHON] Move some logic related to F.nanvl to DataTypeOps 2021-07-30 11:19:49 -07:00
groupby.py [SPARK-36710][PYTHON] Support new typing syntax in function apply APIs in pandas API on Spark 2021-09-20 10:37:06 +09:00
indexing.py [SPARK-36818][PYTHON] Fix filtering a Series by a boolean Series 2021-09-22 12:52:56 -07:00
internal.py [SPARK-36625][SPARK-36661][PYTHON] Support TimestampNTZ in pandas API on Spark 2021-09-09 09:57:38 +09:00
ml.py [SPARK-36146][PYTHON][INFRA][TESTS] Upgrade Python version from 3.6 to 3.9 in GitHub Actions' linter/docs 2021-07-15 08:01:54 -07:00
mlflow.py [SPARK-36254][PYTHON][FOLLOW-UP] Skip mlflow related tests in pandas on Spark 2021-07-30 22:28:19 +09:00
namespace.py [SPARK-36625][SPARK-36661][PYTHON] Support TimestampNTZ in pandas API on Spark 2021-09-09 09:57:38 +09:00
numpy_compat.py [SPARK-35344][PYTHON] Support creating a Column of numpy literals in pandas API on Spark 2021-06-28 19:03:42 -07:00
series.py [SPARK-36506][PYTHON] Improve test coverage for series.py and indexes/*.py 2021-09-23 14:23:52 +09:00
sql_processor.py [SPARK-35809][PYTHON] Add index_col argument for ps.sql 2021-07-22 17:08:34 +09:00
strings.py [SPARK-35761][PYTHON] Use type-annotation based pandas_udf or avoid specifying udf types to suppress warnings 2021-06-15 11:17:56 +09:00
utils.py [SPARK-35806][PYTHON] Mapping the mode argument to pandas in DataFrame.to_csv 2021-07-19 19:58:11 +09:00
window.py [SPARK-36388][SPARK-36386][PYTHON] Fix DataFrame groupby-rolling and groupby-expanding to follow pandas 1.3 2021-08-10 10:12:52 +09:00