921abc51cf
### What changes were proposed in this pull request? This PR proposes to restructure API files according to the layout, see https://github.com/apache/spark/pull/32799. Now the pandas APIs on Spark are under a separate directory which is same level as other modules such as Spark SQL. ```bash tree reference ``` **Before:** ``` reference ├── index.rst ├── ps_extensions.rst ├── ps_frame.rst ├── ps_general_functions.rst ├── ps_groupby.rst ├── ps_indexing.rst ├── ps_io.rst ├── ps_ml.rst ├── ps_series.rst ├── ps_window.rst ├── pyspark.ml.rst ├── pyspark.mllib.rst ├── pyspark.pandas.rst ├── pyspark.resource.rst ├── pyspark.rst ├── pyspark.sql.rst ├── pyspark.ss.rst └── pyspark.streaming.rst ``` **After:** ``` reference ├── index.rst ├── pyspark.ml.rst ├── pyspark.mllib.rst ├── pyspark.pandas │ ├── extensions.rst │ ├── frame.rst │ ├── general_functions.rst │ ├── groupby.rst │ ├── index.rst │ ├── indexing.rst │ ├── io.rst │ ├── ml.rst │ ├── series.rst │ └── window.rst ├── pyspark.resource.rst ├── pyspark.rst ├── pyspark.sql.rst ├── pyspark.ss.rst └── pyspark.streaming.rst ``` ### Why are the changes needed? To make the directory structure easier to follow. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Manually built and tested the docs. Closes #32812 from HyukjinKwon/SPARK-35646-followup. Authored-by: Hyukjin Kwon <gurwls223@apache.org> Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
104 lines
1.2 KiB
ReStructuredText
104 lines
1.2 KiB
ReStructuredText
.. _api.io:
|
|
|
|
============
|
|
Input/Output
|
|
============
|
|
.. currentmodule:: pyspark.pandas
|
|
|
|
|
|
Data Generator
|
|
--------------
|
|
.. autosummary::
|
|
:toctree: api/
|
|
|
|
range
|
|
|
|
Spark Metastore Table
|
|
---------------------
|
|
.. autosummary::
|
|
:toctree: api/
|
|
|
|
read_table
|
|
DataFrame.to_table
|
|
|
|
Delta Lake
|
|
----------
|
|
.. autosummary::
|
|
:toctree: api/
|
|
|
|
read_delta
|
|
DataFrame.to_delta
|
|
|
|
Parquet
|
|
-------
|
|
.. autosummary::
|
|
:toctree: api/
|
|
|
|
read_parquet
|
|
DataFrame.to_parquet
|
|
|
|
ORC
|
|
-------
|
|
.. autosummary::
|
|
:toctree: api/
|
|
|
|
read_orc
|
|
DataFrame.to_orc
|
|
|
|
Generic Spark I/O
|
|
-----------------
|
|
.. autosummary::
|
|
:toctree: api/
|
|
|
|
read_spark_io
|
|
DataFrame.to_spark_io
|
|
|
|
Flat File / CSV
|
|
---------------
|
|
.. autosummary::
|
|
:toctree: api/
|
|
|
|
read_csv
|
|
DataFrame.to_csv
|
|
|
|
Clipboard
|
|
---------
|
|
.. autosummary::
|
|
:toctree: api/
|
|
|
|
read_clipboard
|
|
DataFrame.to_clipboard
|
|
|
|
Excel
|
|
-----
|
|
.. autosummary::
|
|
:toctree: api/
|
|
|
|
read_excel
|
|
DataFrame.to_excel
|
|
|
|
JSON
|
|
----
|
|
.. autosummary::
|
|
:toctree: api/
|
|
|
|
read_json
|
|
DataFrame.to_json
|
|
|
|
HTML
|
|
----
|
|
.. autosummary::
|
|
:toctree: api/
|
|
|
|
read_html
|
|
DataFrame.to_html
|
|
|
|
SQL
|
|
---
|
|
.. autosummary::
|
|
:toctree: api/
|
|
|
|
read_sql_table
|
|
read_sql_query
|
|
read_sql
|