ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity
spark-instrumented-optimizer/python/pyspark/sql
History
zero323 ab88b24106 [SPARK-19427][PYTHON][SQL] Support data type string as a returnType argument of UDF 
## What changes were proposed in this pull request?

Add support for data type string as a return type argument of `UserDefinedFunction`:

```python
f = udf(lambda x: x, "integer")
 f.returnType

## IntegerType
```

## How was this patch tested?

Existing unit tests, additional unit tests covering new feature.

Author: zero323 <zero323@users.noreply.github.com>

Closes #16769 from zero323/SPARK-19427.
2017-02-13 10:37:34 -08:00
..
__init__.py [SPARK-16772][PYTHON][DOCS] Fix API doc references to UDFRegistration + Update "important classes" 2016-08-06 05:02:59 +01:00
catalog.py [SPARK-19148][SQL] do not expose the external table concept in Catalog 2017-01-17 12:54:50 +08:00
column.py [SPARK-19403][PYTHON][SQL] Correct pyspark.sql.column.__all__ list. 2017-01-30 18:01:02 +01:00
conf.py [SPARK-15464][ML][MLLIB][SQL][TESTS] Replace SQLContext and SparkContext with SparkSession using builder pattern in python test code 2016-05-23 18:14:48 -07:00
context.py [SPARK-18687][PYSPARK][SQL] Backward compatibility - creating a Dataframe on a new SQLContext object fails with a Derby error 2017-01-13 18:35:51 +08:00
dataframe.py [SPARK-14352][SQL] approxQuantile should support multi columns 2017-02-01 14:11:28 -08:00
functions.py [SPARK-19427][PYTHON][SQL] Support data type string as a returnType argument of UDF 2017-02-13 10:37:34 -08:00
group.py [MINOR][PYSPARK][DOC] Fix wrongly formatted examples in PySpark documentation 2016-07-06 10:45:51 -07:00
readwriter.py [SPARK-19239][PYSPARK] Check parameters whether equals None when specify the column in jdbc API 2017-01-17 10:37:29 -08:00
session.py [SPARK-19055][SQL][PYSPARK] Fix SparkSession initialization when SparkContext is stopped 2017-01-12 20:53:31 +08:00
streaming.py [SPARK-19140][SS] Allow update mode for non-aggregation streaming queries 2017-01-10 17:58:11 -08:00
tests.py [SPARK-19427][PYTHON][SQL] Support data type string as a returnType argument of UDF 2017-02-13 10:37:34 -08:00
types.py [SPARK-13748][PYSPARK][DOC] Add the description for explictly setting None for a named argument for a Row 2017-01-07 12:52:41 +00:00
utils.py [MINOR][DOCS] Remove consecutive duplicated words/typo in Spark Repo 2017-01-04 15:07:29 +00:00
window.py [SPARK-18690][PYTHON][SQL] Backward compatibility of unbounded frames 2016-12-02 17:39:28 -08:00