ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/python/pyspark/ml
History
Bago Amirbekian 9434280cfd [SPARK-20861][ML][PYTHON] Delegate looping over paramMaps to estimators 
Changes:

pyspark.ml Estimators can take either a list of param maps or a dict of params. This change allows the CrossValidator and TrainValidationSplit Estimators to pass through lists of param maps to the underlying estimators so that those estimators can handle parallelization when appropriate (eg distributed hyper parameter tuning).

Testing:

Existing unit tests.

Author: Bago Amirbekian <bago@databricks.com>

Closes #18077 from MrBago/delegate_params.
2017-05-23 20:56:01 -07:00
..
linalg [SPARK-20214][ML] Make sure converted csc matrix has sorted indices 2017-04-05 17:46:44 -07:00
param [SPARK-14772][PYTHON][ML] Fixed Params.copy method to match Scala implementation 2017-02-23 18:05:58 -08:00
__init__.py [SPARK-14817][ML][MLLIB][DOC] Made DataFrame-based API primary in MLlib guide 2016-07-15 13:38:23 -07:00
base.py [SPARK-15364][ML][PYSPARK] Implement PySpark picklers for ml.Vector and ml.Matrix under spark.ml.python 2016-06-13 19:59:53 -07:00
classification.py [SPARK-20501][ML] ML 2.2 QA: New Scala APIs, docs 2017-05-15 21:21:54 -07:00
clustering.py [SPARK-19348][PYTHON] PySpark keyword_only decorator is not thread-safe 2017-03-03 16:43:45 -08:00
common.py [SPARK-17679] [PYSPARK] remove unnecessary Py4J ListConverter patch 2016-10-03 14:12:03 -07:00
evaluation.py [SPARK-19348][PYTHON] PySpark keyword_only decorator is not thread-safe 2017-03-03 16:43:45 -08:00
feature.py [SPARK-20736][PYTHON] PySpark StringIndexer supports StringOrderType 2017-05-21 16:51:55 -07:00
fpm.py [SPARK-19281][PYTHON][ML] spark.ml Python API for FPGrowth 2017-03-26 16:49:27 -07:00
pipeline.py [SPARK-19348][PYTHON] PySpark keyword_only decorator is not thread-safe 2017-03-03 16:43:45 -08:00
recommendation.py [SPARK-20300][ML][PYSPARK] Python API for ALSModel.recommendForAllUsers,Items 2017-05-02 10:49:13 +02:00
regression.py [SPARK-20764][ML][PYSPARK] Fix visibility discrepancy with numInstances and degreesOfFreedom in LR and GLR - Python version 2017-05-22 22:42:37 +08:00
stat.py [SPARK-20076][ML][PYSPARK] Add Python interface for ml.stats.Correlation 2017-04-07 11:00:10 +02:00
tests.py [SPARK-20631][PYTHON][ML] LogisticRegression._checkThresholdConsistency should use values not Params 2017-05-10 16:57:52 +08:00
tuning.py [SPARK-20861][ML][PYTHON] Delegate looping over paramMaps to estimators 2017-05-23 20:56:01 -07:00
util.py [SPARK-20707][ML] ML deprecated APIs should be removed in major release. 2017-05-16 10:08:23 +08:00
wrapper.py [SPARK-17161][PYSPARK][ML] Add PySpark-ML JavaWrapper convenience function to create Py4J JavaArrays 2017-01-31 15:42:36 -08:00