ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

[SPARK-7550] [SQL] [MINOR] Fixes logs when persisting DataFrames

Browse source 
Author: Cheng Lian <lian@databricks.com>

Closes #8021 from liancheng/spark-7550/fix-logs and squashes the following commits:

b7bd0ed [Cheng Lian] Fixes logs
This commit is contained in:
Cheng Lian 2015-08-06 22:49:01 -07:00 committed by Reynold Xin
parent 672f467668
commit f0cda587fb
1 changed files with 2 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala
View file

@ -317,19 +317,17 @@ private[hive] class HiveMetastoreCatalog(val client: ClientInterface, hive: Hive
case (Some(serde), relation: HadoopFsRelation) if relation.partitionColumns.nonEmpty =>
logWarning {
val paths = relation.paths.mkString(", ")
"Persisting partitioned data source relation into Hive metastore in " +
s"Spark SQL specific format, which is NOT compatible with Hive. Input path(s): " +
paths.mkString("\n", "\n", "")
relation.paths.mkString("\n", "\n", "")
}
newSparkSQLSpecificMetastoreTable()
case (Some(serde), relation: HadoopFsRelation) =>
logWarning {
val paths = relation.paths.mkString(", ")
"Persisting data source relation with multiple input paths into Hive metastore in " +
s"Spark SQL specific format, which is NOT compatible with Hive. Input paths: " +
paths.mkString("\n", "\n", "")
relation.paths.mkString("\n", "\n", "")
}
newSparkSQLSpecificMetastoreTable()