spark-instrumented-optimizer

History

Patrick Wendell 0c1985b153 Fix HDFS access bug with assembly build. Due to this change in HDFS: https://issues.apache.org/jira/browse/HADOOP-7549 there is a bug when using the new assembly builds. The symptom is that any HDFS access results in an exception saying "No filesystem for scheme 'hdfs'". This adds a merge strategy in the assembly build which fixes the problem.		2013-09-10 22:05:13 -07:00
..
lib	Update Maven build to create assemblies expected by new scripts	2013-08-29 21:19:06 -07:00
src/main/assembly	Initial work to rename package to org.apache.spark	2013-09-01 14:13:13 -07:00
pom.xml	Fix HDFS access bug with assembly build.	2013-09-10 22:05:13 -07:00
README	Updating assembly README to reflect recent changes in the build.	2013-09-04 20:54:35 -07:00

README

This is an assembly module for Spark project.

It creates a single tar.gz file that includes all needed dependency of the project
except for org.apache.hadoop.* jars that are supposed to be available from the
deployed Hadoop cluster.

This module is off by default. To activate it specify the profile in the command line
  -Pbigtop-dist

If you need to build an assembly for a different version of Hadoop the
hadoop-version system property needs to be set as in this example:
  -Dhadoop.version=2.0.6-alpha