7e759b2d95
### What changes were proposed in this pull request? make CrossValidator/TrainValidateSplit/OneVsRest Reader/Writer support Python backend estimator/model ### Why are the changes needed? Currently, pyspark support third-party library to define python backend estimator/evaluator, i.e., estimator that inherit `Estimator` instead of `JavaEstimator`, and only can be used in pyspark. CrossValidator and TrainValidateSplit support tuning these python backend estimator, but cannot support saving/load, becase CrossValidator and TrainValidateSplit writer implementation is use JavaMLWriter, which require to convert nested estimator and evaluator into java instance. OneVsRest saving/load now only support java backend classifier due to similar issue. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Unit test. Closes #30471 from WeichenXu123/support_pyio_tuning. Authored-by: Weichen Xu <weichen.xu@databricks.com> Signed-off-by: Weichen Xu <weichen.xu@databricks.com> |
||
---|---|---|
.. | ||
__init__.py | ||
test_algorithms.py | ||
test_base.py | ||
test_evaluation.py | ||
test_feature.py | ||
test_image.py | ||
test_linalg.py | ||
test_param.py | ||
test_persistence.py | ||
test_pipeline.py | ||
test_stat.py | ||
test_training_summary.py | ||
test_tuning.py | ||
test_util.py | ||
test_wrapper.py |