spark-instrumented-optimizer/project
Yanbo Liang f7082ac125 [SPARK-17704][ML][MLLIB] ChiSqSelector performance improvement.
## What changes were proposed in this pull request?
Several performance improvement for ```ChiSqSelector```:
1, Keep ```selectedFeatures``` ordered ascendent.
```ChiSqSelectorModel.transform``` need ```selectedFeatures``` ordered to make prediction. We should sort it when training model rather than making prediction, since users usually train model once and use the model to do prediction multiple times.
2, When training ```fpr``` type ```ChiSqSelectorModel```, it's not necessary to sort the ChiSq test result by statistic.

## How was this patch tested?
Existing unit tests.

Author: Yanbo Liang <ybliang8@gmail.com>

Closes #15277 from yanboliang/spark-17704.
2016-09-29 04:30:42 -07:00
..
build.properties [SPARK-13834][BUILD] Update sbt and sbt plugins for 2.x. 2016-03-13 18:47:04 -07:00
MimaBuild.scala [SPARK-14818] Post-2.0 MiMa exclusion and build changes 2016-09-12 15:24:33 -07:00
MimaExcludes.scala [SPARK-17704][ML][MLLIB] ChiSqSelector performance improvement. 2016-09-29 04:30:42 -07:00
plugins.sbt [SPARK-15827][BUILD] Publish Spark's forked sbt-pom-reader to Maven Central 2016-06-09 11:04:08 -07:00
SparkBuild.scala [SPARK-17639][BUILD] Add jce.jar to buildclasspath when building. 2016-09-22 21:35:25 -07:00