Xiangrui Meng 2e069ca656 [SPARK-3001][MLLIB] Improve Spearman's correlation ... The current implementation requires sorting individual columns, which could be done with a global sort. result on a 32-node cluster: m | n | prev | this ---|---|-------|----- 1000000 | 50 | 55s | 9s 10000000 | 50 | 97s | 76s 1000000 | 100 | 119s | 15s Author: Xiangrui Meng <meng@databricks.com> Closes #1917 from mengxr/spearman and squashes the following commits: 4d5d262 [Xiangrui Meng] remove unused import 85c48de [Xiangrui Meng] minor updates a048d0c [Xiangrui Meng] remove cache and set a limit to cachedIds b98bb18 [Xiangrui Meng] add comments 0846e07 [Xiangrui Meng] first version		2014-08-15 21:07:55 -07:00
..
src	[SPARK-3001][MLLIB] Improve Spearman's correlation	2014-08-15 21:07:55 -07:00
pom.xml	[SPARK-1997][MLLIB] update breeze to 0.9	2014-08-08 15:07:31 -07:00