spark-instrumented-optimizer/python/pyspark/sql
Andrew Or c32b1b162e [SPARK-15417][SQL][PYTHON] PySpark shell always uses in-memory catalog
## What changes were proposed in this pull request?

There is no way to use the Hive catalog in `pyspark-shell`. This is because we used to create a `SparkContext` before calling `SparkSession.enableHiveSupport().getOrCreate()`, which just gets the existing `SparkContext` instead of creating a new one. As a result, `spark.sql.catalogImplementation` was never propagated.

## How was this patch tested?

Manual.

Author: Andrew Or <andrew@databricks.com>

Closes #13203 from andrewor14/fix-pyspark-shell.
2016-05-19 23:44:10 -07:00
..
__init__.py [SPARK-14945][PYTHON] SparkSession Python API 2016-04-28 10:55:48 -07:00
catalog.py [SPARK-15171][SQL] Deprecate registerTempTable and add dataset.createTempView 2016-05-12 15:51:53 +08:00
column.py [SPARK-15278] [SQL] Remove experimental tag from Python DataFrame 2016-05-11 15:12:27 -07:00
conf.py [SPARK-15126][SQL] RuntimeConfig.set should return Unit 2016-05-04 14:26:05 -07:00
context.py [SPARK-15075][SPARK-15345][SQL] Clean up SparkSession builder and propagate config options to existing sessions if specified 2016-05-19 21:53:26 -07:00
dataframe.py [SPARK-15392][SQL] fix default value of size estimation of logical plan 2016-05-19 12:12:42 -07:00
functions.py [SPARK-14639] [PYTHON] [R] Add bround function in Python/R. 2016-04-19 22:28:11 -07:00
group.py [SPARK-12756][SQL] use hash expression in Exchange 2016-01-13 22:43:28 -08:00
readwriter.py [SPARK-14463][SQL] Document the semantics for read.text 2016-05-18 19:16:28 -07:00
session.py [SPARK-15417][SQL][PYTHON] PySpark shell always uses in-memory catalog 2016-05-19 23:44:10 -07:00
streaming.py [SPARK-14896][SQL] Deprecate HiveContext in python 2016-05-04 17:39:30 -07:00
tests.py [SPARK-15342] [SQL] [PYSPARK] PySpark test for non ascii column name does not actually test with unicode column name 2016-05-18 11:18:33 -07:00
types.py [SPARK-15342] [SQL] [PYSPARK] PySpark test for non ascii column name does not actually test with unicode column name 2016-05-18 11:18:33 -07:00
utils.py [SPARK-14603][SQL][FOLLOWUP] Verification of Metadata Operations by Session Catalog 2016-05-19 11:46:11 -07:00
window.py [SPARK-14058][PYTHON] Incorrect docstring in Window.order 2016-03-21 23:52:33 -07:00