spark-instrumented-optimizer/examples
Yuhao Yang 9a0272fbb3 [SPARK-6177][MLlib]Add note in LDA example to remind possible coalesce
JIRA: https://issues.apache.org/jira/browse/SPARK-6177
Add comment to introduce coalesce to LDA example to avoid the possible massive partitions from `sc.textFile`.

sc.textFile will create RDD with one partition for each file, and the possible massive partitions downgrades LDA performance.

Author: Yuhao Yang <hhbyyh@gmail.com>

Closes #4899 from hhbyyh/adjustPartition and squashes the following commits:

a499630 [Yuhao Yang] update comment
9a2d7b6 [Yuhao Yang] move to comment
f7fd5d4 [Yuhao Yang] Merge remote-tracking branch 'upstream/master' into adjustPartition
26a564a [Yuhao Yang] add coalesce to LDAExample
2015-03-10 10:52:21 +00:00
..
scala-2.10/src/main [Streaming][Minor]Fix some error docs in streaming examples 2015-03-02 08:49:19 +00:00
src/main [SPARK-6177][MLlib]Add note in LDA example to remind possible coalesce 2015-03-10 10:52:21 +00:00
pom.xml SPARK-6182 [BUILD] spark-parent pom needs to be published for both 2.10 and 2.11 2015-03-05 11:31:48 -08:00