spark-instrumented-optimizer/python/pyspark/sql
gatorsmile 5c6b085578 [SPARK-14603][SQL] Verification of Metadata Operations by Session Catalog
Since we cannot really trust if the underlying external catalog can throw exceptions when there is an invalid metadata operation, let's do it in SessionCatalog.

- [X] The first step is to unify the error messages issued in Hive-specific Session Catalog and general Session Catalog.
- [X] The second step is to verify the inputs of metadata operations for partitioning-related operations. This is moved to a separate PR: https://github.com/apache/spark/pull/12801
- [X] The third step is to add database existence verification in `SessionCatalog`
- [X] The fourth step is to add table existence verification in `SessionCatalog`
- [X] The fifth step is to add function existence verification in `SessionCatalog`

Add test cases and verify the error messages we issued

Author: gatorsmile <gatorsmile@gmail.com>
Author: xiaoli <lixiao1983@gmail.com>
Author: Xiao Li <xiaoli@Xiaos-MacBook-Pro.local>

Closes #12385 from gatorsmile/verifySessionAPIs.
2016-05-10 11:25:55 -07:00
..
__init__.py [SPARK-14945][PYTHON] SparkSession Python API 2016-04-28 10:55:48 -07:00
catalog.py [SPARK-14988][PYTHON] SparkSession API follow-ups 2016-04-29 16:41:13 -07:00
column.py [SPARK-14896][SQL] Deprecate HiveContext in python 2016-05-04 17:39:30 -07:00
conf.py [SPARK-15126][SQL] RuntimeConfig.set should return Unit 2016-05-04 14:26:05 -07:00
context.py [SPARK-14896][SQL] Deprecate HiveContext in python 2016-05-04 17:39:30 -07:00
dataframe.py [MINOR] remove dead code 2016-05-04 21:30:13 -07:00
functions.py [SPARK-14639] [PYTHON] [R] Add bround function in Python/R. 2016-04-19 22:28:11 -07:00
group.py [SPARK-12756][SQL] use hash expression in Exchange 2016-01-13 22:43:28 -08:00
readwriter.py [SPARK-15050][SQL] Put CSV and JSON options as Python csv and json function parameters 2016-05-02 17:50:40 -07:00
session.py [SPARK-15126][SQL] RuntimeConfig.set should return Unit 2016-05-04 14:26:05 -07:00
streaming.py [SPARK-14896][SQL] Deprecate HiveContext in python 2016-05-04 17:39:30 -07:00
tests.py [SPARK-14716][SQL] Added support for partitioning in FileStreamSink 2016-05-03 10:58:26 -07:00
types.py [SPARK-13842] [PYSPARK] pyspark.sql.types.StructType accessor enhancements 2016-04-20 13:45:14 -07:00
utils.py [SPARK-14603][SQL] Verification of Metadata Operations by Session Catalog 2016-05-10 11:25:55 -07:00
window.py [SPARK-14058][PYTHON] Incorrect docstring in Window.order 2016-03-21 23:52:33 -07:00