ed9d0aac90
## What changes were proposed in this pull request? Fix some broken links in the new document. I have clicked through all the links. Hopefully i haven't missed any :-) ## How was this patch tested? Built using jekyll and verified the links. Closes #22772 from dilipbiswal/doc_check. Authored-by: Dilip Biswal <dbiswal@us.ibm.com> Signed-off-by: gatorsmile <gatorsmile@gmail.com>
43 lines
2.8 KiB
Markdown
43 lines
2.8 KiB
Markdown
---
|
|
layout: global
|
|
title: Data Sources
|
|
displayTitle: Data Sources
|
|
---
|
|
|
|
|
|
Spark SQL supports operating on a variety of data sources through the DataFrame interface.
|
|
A DataFrame can be operated on using relational transformations and can also be used to create a temporary view.
|
|
Registering a DataFrame as a temporary view allows you to run SQL queries over its data. This section
|
|
describes the general methods for loading and saving data using the Spark Data Sources and then
|
|
goes into specific options that are available for the built-in data sources.
|
|
|
|
|
|
* [Generic Load/Save Functions](sql-data-sources-load-save-functions.html)
|
|
* [Manually Specifying Options](sql-data-sources-load-save-functions.html#manually-specifying-options)
|
|
* [Run SQL on files directly](sql-data-sources-load-save-functions.html#run-sql-on-files-directly)
|
|
* [Save Modes](sql-data-sources-load-save-functions.html#save-modes)
|
|
* [Saving to Persistent Tables](sql-data-sources-load-save-functions.html#saving-to-persistent-tables)
|
|
* [Bucketing, Sorting and Partitioning](sql-data-sources-load-save-functions.html#bucketing-sorting-and-partitioning)
|
|
* [Parquet Files](sql-data-sources-parquet.html)
|
|
* [Loading Data Programmatically](sql-data-sources-parquet.html#loading-data-programmatically)
|
|
* [Partition Discovery](sql-data-sources-parquet.html#partition-discovery)
|
|
* [Schema Merging](sql-data-sources-parquet.html#schema-merging)
|
|
* [Hive metastore Parquet table conversion](sql-data-sources-parquet.html#hive-metastore-parquet-table-conversion)
|
|
* [Configuration](sql-data-sources-parquet.html#configuration)
|
|
* [ORC Files](sql-data-sources-orc.html)
|
|
* [JSON Files](sql-data-sources-json.html)
|
|
* [Hive Tables](sql-data-sources-hive-tables.html)
|
|
* [Specifying storage format for Hive tables](sql-data-sources-hive-tables.html#specifying-storage-format-for-hive-tables)
|
|
* [Interacting with Different Versions of Hive Metastore](sql-data-sources-hive-tables.html#interacting-with-different-versions-of-hive-metastore)
|
|
* [JDBC To Other Databases](sql-data-sources-jdbc.html)
|
|
* [Avro Files](sql-data-sources-avro.html)
|
|
* [Deploying](sql-data-sources-avro.html#deploying)
|
|
* [Load and Save Functions](sql-data-sources-avro.html#load-and-save-functions)
|
|
* [to_avro() and from_avro()](sql-data-sources-avro.html#to_avro-and-from_avro)
|
|
* [Data Source Option](sql-data-sources-avro.html#data-source-option)
|
|
* [Configuration](sql-data-sources-avro.html#configuration)
|
|
* [Compatibility with Databricks spark-avro](sql-data-sources-avro.html#compatibility-with-databricks-spark-avro)
|
|
* [Supported types for Avro -> Spark SQL conversion](sql-data-sources-avro.html#supported-types-for-avro---spark-sql-conversion)
|
|
* [Supported types for Spark SQL -> Avro conversion](sql-data-sources-avro.html#supported-types-for-spark-sql---avro-conversion)
|
|
* [Troubleshooting](sql-data-sources-troubleshooting.html)
|