spark-instrumented-optimizer

History

Patrick Wendell c3196171f3 Merge pull request #502 from pwendell/clone-1 Remove Hadoop object cloning and warn users making Hadoop RDD's. The code introduced in #359 used Hadoop's WritableUtils.clone() to duplicate objects when reading from Hadoop files. Some users have reported exceptions when cloning data in various file formats, including Avro and another custom format. This patch removes that functionality to ensure stability for the 0.9 release. Instead, it puts a clear warning in the documentation that copying may be necessary for Hadoop data sets.	2014-01-23 19:11:59 -08:00
..
main	Merge pull request #502 from pwendell/clone-1	2014-01-23 19:11:59 -08:00
test	fix for SPARK-1027	2014-01-20 02:50:30 -05:00

Patrick Wendell c3196171f3 Merge pull request #502 from pwendell/clone-1

Remove Hadoop object cloning and warn users making Hadoop RDD's.

The code introduced in #359 used Hadoop's WritableUtils.clone() to
duplicate objects when reading from Hadoop files. Some users have
reported exceptions when cloning data in various file formats,
including Avro and another custom format.

This patch removes that functionality to ensure stability for the
0.9 release. Instead, it puts a clear warning in the documentation
that copying may be necessary for Hadoop data sets.

2014-01-23 19:11:59 -08:00

main

Merge pull request #502 from pwendell/clone-1

2014-01-23 19:11:59 -08:00

test

fix for SPARK-1027

2014-01-20 02:50:30 -05:00