Dan Crankshaw
1022e9bf17
Fixed code review changes.
2013-11-18 18:08:32 -08:00
Dan Crankshaw
2aaa095687
Merge branch 'master' of github.com:amplab/graphx
2013-11-17 19:35:43 -08:00
Ankur Dave
62a2a71c37
Merge pull request #65 from amplab/varenc
...
Use variable encoding for ints, longs, and doubles in the specialized serializers.
2013-11-15 13:12:07 -08:00
Reynold Xin
2c39d809d6
Merge pull request #69 from jegonzal/MissingVertices
...
Addressing issue in Graph creation
2013-11-13 23:28:01 -08:00
Joey
33b2deafe6
Merge pull request #1 from ankurdave/MissingVertices
...
During graph creation, create eTable earlier
2013-11-13 17:55:58 -08:00
Ankur Dave
3558e8bda1
During graph creation, create eTable earlier
2013-11-13 17:07:23 -08:00
Joseph E. Gonzalez
5a9b07ead2
Fixing documentation
2013-11-13 10:45:25 -08:00
Joseph E. Gonzalez
266eb01ce8
Addressing issue in Graph creation where a graph created with a vertex set that does not span all of the vertices in the edges will crash on triplet construction.
2013-11-13 10:45:25 -08:00
Reynold Xin
a81fcb749d
Merge pull request #68 from jegonzal/BitSetSetUntilBug
...
Addressing bug in BitSet.setUntil(ind)
2013-11-13 10:41:01 -08:00
Joseph E. Gonzalez
f0ef75c7a4
Addressing bug in BitSet.setUntil(ind) where if invoked with a multiple of 64 could lead to an index out of bounds error.
2013-11-13 10:35:23 -08:00
Reynold Xin
882d069189
Fixed the bug in variable encoding for longs.
2013-11-12 18:50:03 -08:00
Reynold Xin
1e5c17812d
Use variable encoding for ints, longs, and doubles in the specialized serializers.
2013-11-12 15:30:27 -08:00
Dan Crankshaw
a13460bb64
Updated documentation
2013-11-11 23:42:02 -08:00
Dan Crankshaw
7c573a8b43
Added PartitionStrategy option
2013-11-11 23:42:01 -08:00
Dan Crankshaw
8d8056da14
Fixed issue with canonical edge partitioner.
2013-11-11 23:40:23 -08:00
Dan Crankshaw
4a670ef0ba
Merge branch 'master' of github.com:amplab/graphx
2013-11-11 21:42:08 -08:00
Joey
143c01dbd6
Update README.md
...
Changing image references to master branch.
2013-11-11 19:37:16 -08:00
Reynold Xin
2e8d45032d
Merge pull request #63 from jegonzal/VertexSetCleanup
...
Cleanup of VertexSetRDD
2013-11-11 17:34:09 -08:00
Joseph E. Gonzalez
577092080c
Cleanning up documentation of VertexSetRDD.scala
2013-11-11 17:29:22 -08:00
Reynold Xin
b8e294a21b
Merge pull request #61 from ankurdave/pid2vid
...
Shuffle replicated vertex attributes efficiently in columnar format
2013-11-11 16:25:42 -08:00
Reynold Xin
3d7277ccbe
Merge pull request #55 from ankurdave/aggregateNeighbors-variants
...
Specialize mapReduceTriplets for accessing subsets of vertex attributes
2013-11-11 15:49:28 -08:00
Ankur Dave
bee1015620
Handle ClassNotFoundException from ByteCodeUtils
...
ByteCodeUtils.invokedMethod(), which we use in mapReduceTriplets, throws
a ClassNotFoundException when called with a closure defined in the
console. This commit catches the exception and conservatively assumes
the closure references all edge attributes.
2013-11-10 23:00:37 -08:00
Dan Crankshaw
60db25bded
Fixed merge conflicts.
2013-11-10 15:45:55 -08:00
Ankur Dave
d1ff1b7222
Build pid2vid structures only once, in Vid2Pid
2013-11-10 14:47:39 -08:00
Ankur Dave
502c511711
Use pid2vid for creating VTableReplicatedValues
2013-11-10 14:36:14 -08:00
Ankur Dave
53d24a973e
Fix typo
2013-11-10 14:24:38 -08:00
Ankur Dave
aa24b0bbe8
Add test for mapReduceTriplets in GraphSuite
2013-11-10 14:24:38 -08:00
Ankur Dave
bf4e45e685
Factor out VTableReplicatedValues
2013-11-10 14:24:38 -08:00
Ankur Dave
cdbd19bbee
Create all versions of vid2pid ahead of time
2013-11-10 14:10:23 -08:00
Ankur Dave
27e4355d61
Test no vertex attribute replication
2013-11-10 14:04:12 -08:00
Ankur Dave
80abc28078
Optimize mrTriplets for source-attr-only mapF using bytecode inspection
2013-11-10 14:04:12 -08:00
Joey
1a06f707e3
Merge pull request #60 from amplab/rxin
...
Looks good to me.
2013-11-10 10:54:44 -08:00
Reynold Xin
0e813cd483
Fix the hanging bug.
2013-11-09 23:29:37 -08:00
Reynold Xin
f6c946206a
Merge pull request #58 from jegonzal/KryoMessages
...
Kryo messages
2013-11-09 16:14:45 -08:00
Joseph E. Gonzalez
6083e4350f
Adding unit tests to reproduce error.
2013-11-08 15:39:30 -08:00
Joseph E. Gonzalez
161784d0e6
Fixing tests
2013-11-07 20:40:21 -08:00
Joseph E. Gonzalez
e523f0d2fb
merged and debugged
2013-11-07 20:19:49 -08:00
Joseph E. Gonzalez
908e606473
Additional optimizations
2013-11-07 19:47:30 -08:00
Reynold Xin
bac7be30cd
Made more specialized messages.
2013-11-07 19:39:48 -08:00
Reynold Xin
64ad3b18d9
Merge branch 'master' into rxin
...
Conflicts:
graph/src/main/scala/org/apache/spark/graph/impl/GraphImpl.scala
2013-11-07 19:23:42 -08:00
Reynold Xin
2406bf33e4
Use custom serializer for aggregation messages when the data type is int/double.
2013-11-07 19:18:58 -08:00
Ankur Dave
6ee05be1c8
Merge pull request #49 from jegonzal/graphxshell
...
GraphX Console with Logo Text
2013-11-07 19:12:41 -08:00
Ankur Dave
a9f96b54e4
Merge pull request #56 from jegonzal/PregelAPIChanges
...
Changing Pregel API to use mapReduceTriplets instead of aggregateNeighbors
2013-11-07 18:56:56 -08:00
Joseph E. Gonzalez
e9308e0e75
Changing Pregel API to operate directly on edge triplets in SendMessage rather than (Vid, EdgeTriplet) pairs.
2013-11-07 18:04:06 -08:00
Reynold Xin
5907137d11
Merge pull request #54 from amplab/rxin
...
Converted for loops to while loops in EdgePartition.
2013-11-07 16:58:31 -08:00
Reynold Xin
6fadff2b92
Converted for loops to while loops in EdgePartition.
2013-11-07 16:54:33 -08:00
Reynold Xin
edf41647f4
Merge pull request #53 from amplab/rxin
...
Added GraphX to classpath.
2013-11-07 16:22:43 -08:00
Reynold Xin
95f1f5315e
Added GraphX to classpath.
2013-11-07 16:22:05 -08:00
Reynold Xin
c379e10455
Merge pull request #51 from jegonzal/VertexSetRDD
...
Reverting to Array based (materialized) output in VertexSetRDD
2013-11-07 16:01:47 -08:00
Dan Crankshaw
384befb208
Merge branch 'master' of github.com:amplab/graphx
2013-11-06 19:50:55 -08:00
