f540031419
### What changes were proposed in this pull request? This PR enhances `Catalog.createTable()` to allow users to set the table's description. This corresponds to the following SQL syntax: ```sql CREATE TABLE ... COMMENT 'this is a fancy table'; ``` ### Why are the changes needed? This brings the Scala/Python catalog APIs a bit closer to what's already possible via SQL. ### Does this PR introduce any user-facing change? Yes, it adds a new parameter to `Catalog.createTable()`. ### How was this patch tested? Existing unit tests: ```sh ./python/run-tests \ --python-executables python3.7 \ --testnames 'pyspark.sql.tests.test_catalog,pyspark.sql.tests.test_context' ``` ``` $ ./build/sbt testOnly org.apache.spark.sql.internal.CatalogSuite org.apache.spark.sql.CachedTableSuite org.apache.spark.sql.hive.MetastoreDataSourcesSuite org.apache.spark.sql.hive.execution.HiveDDLSuite ``` Closes #27908 from nchammas/SPARK-31000-table-description. Authored-by: Nicholas Chammas <nicholas.chammas@liveramp.com> Signed-off-by: HyukjinKwon <gurwls223@apache.org> |
||
---|---|---|
.. | ||
__init__.py | ||
test_arrow.py | ||
test_catalog.py | ||
test_column.py | ||
test_conf.py | ||
test_context.py | ||
test_dataframe.py | ||
test_datasources.py | ||
test_functions.py | ||
test_group.py | ||
test_pandas_cogrouped_map.py | ||
test_pandas_grouped_map.py | ||
test_pandas_map.py | ||
test_pandas_udf.py | ||
test_pandas_udf_grouped_agg.py | ||
test_pandas_udf_scalar.py | ||
test_pandas_udf_typehints.py | ||
test_pandas_udf_window.py | ||
test_readwriter.py | ||
test_serde.py | ||
test_session.py | ||
test_streaming.py | ||
test_types.py | ||
test_udf.py | ||
test_utils.py |