Reynold Xin
e72bd91590
Merge branch 'clean1' of github.com:amplab/graphx into clean1
2013-11-30 14:04:45 -08:00
Reynold Xin
7528e6d5f1
Enable joining arbitrary VertexPartitions (with different indexes).
2013-11-30 14:04:16 -08:00
Ankur Dave
eed3195038
Fix VertexSetRDD test by enabling index reuse
2013-11-30 13:50:37 -08:00
Ankur Dave
dee1318d3d
Fix join error by caching vTable in mapReduceTriplets
2013-11-30 13:37:19 -08:00
Reynold Xin
10c0f9b0bb
Added a log4j properties file for graphx unit tests.
2013-11-30 13:18:43 -08:00
Reynold Xin
95e83af209
More, bigger cleaning for better encapsulation of VertexSetRDD and VertexPartition. This is work in progress as stuff doesn't really run.
2013-11-27 00:30:26 -08:00
Reynold Xin
caba162861
Added join and aggregateUsingIndex to VertexPartition.
2013-11-26 21:02:39 -08:00
Reynold Xin
2d19d0381b
Merge branch 'simplify' into clean
2013-11-26 13:55:26 -08:00
Reynold Xin
d58bfa8573
Code cleaning to improve readability.
2013-11-26 13:54:46 -08:00
Dan Crankshaw
4b6b15dadd
Actually use partitioner command line args in Analytics.
2013-11-24 16:38:38 -08:00
Ankur Dave
fad6e70add
Simplify GraphImpl internals
2013-11-23 02:59:56 -08:00
Reynold Xin
18ce7e940b
Merge pull request #73 from jegonzal/TriangleCount
...
Triangle count
2013-11-22 17:02:40 -08:00
Joseph E. Gonzalez
de3d6ee5a7
Fixing build after merging upstream changes.
2013-11-19 22:03:49 -08:00
Joseph E. Gonzalez
12cb19b1c1
Adding comments and addressing comments.
2013-11-19 21:37:29 -08:00
Joseph E. Gonzalez
ae4ffc319a
Setting the initial vertex set size to be small.
2013-11-19 21:36:15 -08:00
Joseph E. Gonzalez
18700b6e74
Switching mapReduceTriplets mapFunction to return iterator instead of array to allow optimizations of the returned object.
2013-11-19 21:36:15 -08:00
Joseph E. Gonzalez
983810ad69
Now with style. Addressing most of Reynolds comments.
2013-11-19 21:35:03 -08:00
Joseph E. Gonzalez
2093a17ff3
Adding triangle count code
2013-11-19 21:35:03 -08:00
Joseph E. Gonzalez
8719ba83c8
Modifying graph loaders to create initial vertex sets more efficiently and load undirected graphs.
2013-11-19 21:35:02 -08:00
Joseph E. Gonzalez
288ae310e7
adding test for collectNeighborIds
2013-11-19 21:03:00 -08:00
Joseph E. Gonzalez
2fc6f5bd47
Switching collectNeighborIds to use mapReduceTriplets directly
2013-11-19 21:03:00 -08:00
Dan Crankshaw
96fafdbd4b
Removed sleep from pagerank in Analytics.
2013-11-19 20:39:34 -08:00
Dan Crankshaw
37a524d91c
Addressed code review comments.
2013-11-19 16:39:39 -08:00
Dan Crankshaw
5f3ee53751
Added accessVertexAttr func which somehow got lost in a merge.
2013-11-18 19:34:02 -08:00
Dan Crankshaw
8a460e1811
Added partitioner to GraphImpl constructor args.
2013-11-18 19:32:03 -08:00
Dan Crankshaw
1022e9bf17
Fixed code review changes.
2013-11-18 18:08:32 -08:00
Dan Crankshaw
2aaa095687
Merge branch 'master' of github.com:amplab/graphx
2013-11-17 19:35:43 -08:00
Ankur Dave
62a2a71c37
Merge pull request #65 from amplab/varenc
...
Use variable encoding for ints, longs, and doubles in the specialized serializers.
2013-11-15 13:12:07 -08:00
Ankur Dave
3558e8bda1
During graph creation, create eTable earlier
2013-11-13 17:07:23 -08:00
Joseph E. Gonzalez
5a9b07ead2
Fixing documentation
2013-11-13 10:45:25 -08:00
Joseph E. Gonzalez
266eb01ce8
Addressing issue in Graph creation where a graph created with a vertex set that does not span all of the vertices in the edges will crash on triplet construction.
2013-11-13 10:45:25 -08:00
Reynold Xin
882d069189
Fixed the bug in variable encoding for longs.
2013-11-12 18:50:03 -08:00
Reynold Xin
1e5c17812d
Use variable encoding for ints, longs, and doubles in the specialized serializers.
2013-11-12 15:30:27 -08:00
Dan Crankshaw
a13460bb64
Updated documentation
2013-11-11 23:42:02 -08:00
Dan Crankshaw
7c573a8b43
Added PartitionStrategy option
2013-11-11 23:42:01 -08:00
Dan Crankshaw
8d8056da14
Fixed issue with canonical edge partitioner.
2013-11-11 23:40:23 -08:00
Dan Crankshaw
4a670ef0ba
Merge branch 'master' of github.com:amplab/graphx
2013-11-11 21:42:08 -08:00
Joseph E. Gonzalez
577092080c
Cleanning up documentation of VertexSetRDD.scala
2013-11-11 17:29:22 -08:00
Reynold Xin
b8e294a21b
Merge pull request #61 from ankurdave/pid2vid
...
Shuffle replicated vertex attributes efficiently in columnar format
2013-11-11 16:25:42 -08:00
Ankur Dave
bee1015620
Handle ClassNotFoundException from ByteCodeUtils
...
ByteCodeUtils.invokedMethod(), which we use in mapReduceTriplets, throws
a ClassNotFoundException when called with a closure defined in the
console. This commit catches the exception and conservatively assumes
the closure references all edge attributes.
2013-11-10 23:00:37 -08:00
Dan Crankshaw
60db25bded
Fixed merge conflicts.
2013-11-10 15:45:55 -08:00
Ankur Dave
d1ff1b7222
Build pid2vid structures only once, in Vid2Pid
2013-11-10 14:47:39 -08:00
Ankur Dave
502c511711
Use pid2vid for creating VTableReplicatedValues
2013-11-10 14:36:14 -08:00
Ankur Dave
53d24a973e
Fix typo
2013-11-10 14:24:38 -08:00
Ankur Dave
aa24b0bbe8
Add test for mapReduceTriplets in GraphSuite
2013-11-10 14:24:38 -08:00
Ankur Dave
bf4e45e685
Factor out VTableReplicatedValues
2013-11-10 14:24:38 -08:00
Ankur Dave
cdbd19bbee
Create all versions of vid2pid ahead of time
2013-11-10 14:10:23 -08:00
Ankur Dave
27e4355d61
Test no vertex attribute replication
2013-11-10 14:04:12 -08:00
Ankur Dave
80abc28078
Optimize mrTriplets for source-attr-only mapF using bytecode inspection
2013-11-10 14:04:12 -08:00
Reynold Xin
0e813cd483
Fix the hanging bug.
2013-11-09 23:29:37 -08:00
