9f42be25eb
### What changes were proposed in this pull request? Instead of having several overloads of `getTable` method in `TableProvider`, it's better to have 2 methods explicitly: `inferSchema` and `inferPartitioning`. With a single `getTable` method that takes everything: schema, partitioning and properties. This PR also adds a `supportsExternalMetadata` method in `TableProvider`, to indicate if the source support external table metadata. If this flag is false: 1. spark.read.schema... is disallowed and fails 2. when we support creating v2 tables in session catalog, spark only keeps table properties in the catalog. ### Why are the changes needed? API improvement. ### Does this PR introduce any user-facing change? no ### How was this patch tested? existing tests Closes #26868 from cloud-fan/provider2. Authored-by: Wenchen Fan <wenchen@databricks.com> Signed-off-by: Wenchen Fan <wenchen@databricks.com> |
||
|---|---|---|
| .. | ||
| benchmarks | ||
| src | ||
| v1.2/src | ||
| v2.3/src | ||
| pom.xml | ||