f84a720fe3
### What changes were proposed in this pull request? - Introduce a DecimalOps for DecimalType - Make `isnull` method data-type-based ### Why are the changes needed? Now DecimalType, DoubleType, and FloatType data share the FractionalOps class, but DecimalType behaves differently from FloatType and DoubleType (as https://github.com/apache/spark/blob/master/python/pyspark/pandas/base.py#L987-L990), so we propose to introduce DecimalOps. The behavior difference here is caused by DecimalType could not have NaN. https://issues.apache.org/jira/browse/SPARK-35342 ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? - New added DecimalOpsTest passed - Existing NumOpsTest passed Closes #32821 from Yikun/SPARK-35342. Authored-by: Yikun Jiang <yikunkero@gmail.com> Signed-off-by: Takuya UESHIN <ueshin@databricks.com> |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| modules.py | ||
| shellutils.py | ||
| toposort.py | ||