ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
5051 commits 6 branches 181 tags 397 MiB
Commit graph

5051 commits

This branch
This branch
All branches
Author SHA1 Message Date
Jianping J Wang 779c66ae4e refactor and fix bugs 2013-12-31 16:59:05 +08:00
Jianping J Wang 600421d8bc update 2013-12-30 23:42:55 +08:00
Jianping J Wang 29fe6bdaa2 refactor and bug fix 2013-12-30 23:41:15 +08:00
Reynold Xin 44e4205ac5 Merge pull request #116 from jianpingjwang/master 
remove unused variables and fix a bug
 2013-12-22 11:44:18 -08:00
Wang Jianping J e64a794a44 Update Svdpp.scala 2013-12-22 18:20:49 +08:00
Wang Jianping J b4bce88a2d Update Svdpp.scala 2013-12-21 16:08:19 +08:00
Wang Jianping J 49eb0f1351 Update Svdpp.scala 2013-12-21 15:51:05 +08:00
Wang Jianping J f986e4a136 Update Svdpp.scala 2013-12-21 13:18:11 +08:00
Wang Jianping J 47eefd30ed add javadoc 2013-12-21 13:02:59 +08:00
Reynold Xin 4797c227ff Merge pull request #118 from ankurdave/VertexPartitionSuite 
Test VertexPartition and fix bugs
 2013-12-20 13:30:39 -08:00
Ankur Dave 32508e20d4 Test VertexPartition and fix bugs 2013-12-20 13:00:06 -08:00
Reynold Xin ac70b8f234 Merge pull request #117 from ankurdave/more-tests 
More tests
 2013-12-20 10:56:10 -08:00
Ankur Dave efc765cf1a Test all methods on EdgePartition 2013-12-20 01:30:33 -08:00
Ankur Dave 752c0106e8 Test EdgePartition2D 2013-12-20 01:06:49 -08:00
Wang Jianping J 343d8977aa remove unused variable and fix a bug 2013-12-20 16:57:24 +08:00
Ankur Dave c3ec91a462 Write mapTriplets test 2013-12-20 00:30:21 -08:00
Reynold Xin 45310d4a8b Merge pull request #115 from ankurdave/test-reorg 
Reorganize unit tests; improve GraphSuite test coverage
 2013-12-19 22:08:20 -08:00
Ankur Dave 95381dfb94 Split AnalyticsSuite into algorithms suites 2013-12-19 20:46:03 -08:00
Ankur Dave a69465b1fa Split VertexRDD tests; fix #114 2013-12-19 20:32:30 -08:00
Ankur Dave da9f5e3fc0 Split GraphSuite; simplify LocalSparkContext 2013-12-19 19:49:07 -08:00
Ankur Dave da301b57fc Merge pull request #112 from amatsukawa/scc 
Strongly connected component algorithm
 2013-12-18 20:03:29 -08:00
Akihiro Matsukawa 989f22b365 added scc tests 2013-12-18 18:22:53 -08:00
Akihiro Matsukawa b1db1b6c84 scc algorithm 2013-12-18 18:22:43 -08:00
Ankur Dave a645ef633d Merge pull request #48 from amatsukawa/add_project_to_graph 
Add mask operation on graph and filter graph primitive
 2013-12-18 16:07:52 -08:00
Akihiro Matsukawa d7ebff0272 Merge pull request #1 from ankurdave/add_project_to_graph 
Merge current master and reimplement Graph.mask using innerJoin
 2013-12-18 15:38:48 -08:00
Ankur Dave 0f137e8b75 Reimplement Graph.mask using innerJoin 2013-12-18 13:01:13 -08:00
Ankur Dave 9193a8f788 Merge remote-tracking branch 'upstream/master' into add_project_to_graph 
Conflicts:
	graph/src/main/scala/org/apache/spark/graph/Graph.scala
	graph/src/main/scala/org/apache/spark/graph/impl/GraphImpl.scala
 2013-12-18 13:00:58 -08:00
Joey 3fd2e09ffb Merge pull request #104 from jianpingjwang/master 
SVD++ demo
 2013-12-18 12:52:36 -08:00
Wang Jianping J 06581b6a96 Update Svdpp.scala 2013-12-18 06:51:37 +08:00
Wang Jianping J ba538797dd Update Svdpp.scala 2013-12-18 06:42:19 +08:00
Wang Jianping J e94fe39d0f Update Svdpp.scala 2013-12-18 06:39:28 +08:00
Joey 1b5eacbb28 Merge pull request #102 from ankurdave/clustered-edge-index 
Add clustered index on edges by source vertex
 2013-12-17 13:49:17 -08:00
Wang Jianping J 772b192910 Update AnalyticsSuite.scala 2013-12-17 19:41:04 +08:00
Wang Jianping J 9d2351f501 Update Svdpp.scala 2013-12-17 19:30:07 +08:00
Wang Jianping J aee71156f3 Test SVD++ 2013-12-17 19:20:25 +08:00
Wang Jianping J fb1d1e45f1 Update Svdpp.scala 2013-12-17 19:17:40 +08:00
Ankur Dave 3ade8be8f2 Add clustered index on edges by source vertex 
This allows efficient edge scan in mapReduceTriplets when many source
vertices are inactive. The scan method switches from edge scan to
clustered index scan when less than 80% of source vertices are active.
 2013-12-16 17:37:51 -08:00
Joey 0476c84c51 Merge pull request #100 from ankurdave/mrTriplets-active-set 
Support activeSet option in mapReduceTriplets
 2013-12-16 17:19:25 -08:00
Ankur Dave 9df565007b Merge remote-tracking branch 'upstream/master' into mrTriplets-active-set 
Conflicts:
	graph/src/main/scala/org/apache/spark/graph/impl/GraphImpl.scala
 2013-12-16 16:24:43 -08:00
Joey 5192ef3859 Merge pull request #94 from ankurdave/load-edges-columnar 
Load edges in columnar format
 2013-12-16 15:08:08 -08:00
Wang Jianping J 5eb21e6720 SVD++ demo 2013-12-16 20:01:31 +08:00
Reynold Xin ded10ce5b0 Merge pull request #103 from amplab/optimizations 
Optimizations cherry-picked from SIGMOD branches
 2013-12-15 17:25:33 -08:00
Reynold Xin bad85b051d Use murmur3 hash for open hashset. 
(cherry picked from commit 212ff6834515543163aa63a3f4f762ebe641f8ca)
Signed-off-by: Ankur Dave <ankurdave@gmail.com>
 2013-12-15 17:23:15 -08:00
Reynold Xin 62bdc44a1e Unrolled while loop in readVarLong. 
(cherry picked from commit 45ffb1ae3c0527aae50502741a3585c411875b9a)
Signed-off-by: Ankur Dave <ankurdave@gmail.com>
 2013-12-15 17:23:15 -08:00
Ankur Dave 0459747c1c Fix typo 2013-12-14 17:08:04 -08:00
Ankur Dave 8a56c1ff67 Merge pull request #84 from amatsukawa/graphlab_enhancements 
GraphLab bug fix & set start vertex
 2013-12-14 16:29:24 -08:00
Ankur Dave 1ad3d240b0 Remove commented code 2013-12-14 15:49:00 -08:00
Ankur Dave 7dbd3bf825 Remove debug printing from PregelSuite 2013-12-14 15:45:23 -08:00
Ankur Dave e9cd634d05 Merge remote-tracking branch 'upstream/master' into mrTriplets-active-set 
Updates standalone PageRank to work with the new API.
 2013-12-14 15:44:35 -08:00
Ankur Dave 0c3fc1c1b6 Avoid re-creating the view RDDs multiple times 
Previously, successive operations that support incremental view
maintenance would inadvertently recreate previous view RDDs by calling
VTableReplicated.get(), which created the RDDs anew though they were
already cached. This change memoizes the RDDs and separates the process
of shipping active-set information to an existing view.
 2013-12-14 15:28:24 -08:00