Vinayak 285a7798e2 [SPARK-18687][PYSPARK][SQL] Backward compatibility - creating a Dataframe on a new SQLContext object fails with a Derby error ... Change is for SQLContext to reuse the active SparkSession during construction if the sparkContext supplied is the same as the currently active SparkContext. Without this change, a new SparkSession is instantiated that results in a Derby error when attempting to create a dataframe using a new SQLContext object even though the SparkContext supplied to the new SQLContext is same as the currently active one. Refer https://issues.apache.org/jira/browse/SPARK-18687 for details on the error and a repro. Existing unit tests and a new unit test added to pyspark-sql: /python/run-tests --python-executables=python --modules=pyspark-sql Please review http://spark.apache.org/contributing.html before opening a pull request. Author: Vinayak <vijoshi5@in.ibm.com> Author: Vinayak Joshi <vijoshi@users.noreply.github.com> Closes #16119 from vijoshi/SPARK-18687_master.		2017-01-13 18:35:51 +08:00
..
__init__.py	[SPARK-16772][PYTHON][DOCS] Fix API doc references to UDFRegistration + Update "important classes"	2016-08-06 05:02:59 +01:00
catalog.py	[SPARK-18949][SQL] Add recoverPartitions API to Catalog	2016-12-20 23:40:02 -08:00
column.py	[SPARK-17215][SQL] Method SQLContext.parseDataType(dataTypeString: String) could be removed.	2016-08-24 23:36:04 -07:00
conf.py	[SPARK-15464][ML][MLLIB][SQL][TESTS] Replace SQLContext and SparkContext with SparkSession using builder pattern in python test code	2016-05-23 18:14:48 -07:00
context.py	[SPARK-18687][PYSPARK][SQL] Backward compatibility - creating a Dataframe on a new SQLContext object fails with a Derby error	2017-01-13 18:35:51 +08:00
dataframe.py	[SPARK-19126][DOCS] Update Join Documentation Across Languages	2017-01-08 20:37:46 -08:00
functions.py	[SPARK-19164][PYTHON][SQL] Remove unused UserDefinedFunction._broadcast	2017-01-12 01:05:02 -08:00
group.py	[MINOR][PYSPARK][DOC] Fix wrongly formatted examples in PySpark documentation	2016-07-06 10:45:51 -07:00
readwriter.py	[SPARK-17764][SQL] Add to_json supporting to convert nested struct column to JSON string	2016-11-01 12:46:41 -07:00
session.py	[SPARK-19055][SQL][PYSPARK] Fix SparkSession initialization when SparkContext is stopped	2017-01-12 20:53:31 +08:00
streaming.py	[SPARK-19140][SS] Allow update mode for non-aggregation streaming queries	2017-01-10 17:58:11 -08:00
tests.py	[SPARK-18687][PYSPARK][SQL] Backward compatibility - creating a Dataframe on a new SQLContext object fails with a Derby error	2017-01-13 18:35:51 +08:00
types.py	[SPARK-13748][PYSPARK][DOC] Add the description for explictly setting None for a named argument for a Row	2017-01-07 12:52:41 +00:00
utils.py	[MINOR][DOCS] Remove consecutive duplicated words/typo in Spark Repo	2017-01-04 15:07:29 +00:00
window.py	[SPARK-18690][PYTHON][SQL] Backward compatibility of unbounded frames	2016-12-02 17:39:28 -08:00