ODIn/spark-instrumented-optimizer
1
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

[MINOR][DOCS][STREAMING] Minor docfix schema of csv rather than parquet in comments

Browse source 
## What changes were proposed in this pull request?

Fix parquet to csv in a comment to match the input format being read.

## How was this patch tested?
N/A (doc change only)

Author: Holden Karau <holden@us.ibm.com>

Closes #14274 from holdenk/minor-docfix-schema-of-csv-rather-than-parquet.
This commit is contained in:
Holden Karau 2016-07-21 09:17:38 +01:00 committed by Sean Owen
parent cfa5ae84ed
commit 1bf13ba3a2
1 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
docs/structured-streaming-programming-guide.md
View file

@ -449,7 +449,7 @@ val userSchema = new StructType().add("name", "string").add("age", "integer")
val csvDF = spark val csvDF = spark
.readStream .readStream
.option("sep", ";") .option("sep", ";")
.schema(userSchema) // Specify schema of the parquet files .schema(userSchema) // Specify schema of the csv files
.csv("/path/to/directory") // Equivalent to format("csv").load("/path/to/directory") .csv("/path/to/directory") // Equivalent to format("csv").load("/path/to/directory")
{% endhighlight %} {% endhighlight %}
@ -476,7 +476,7 @@ StructType userSchema = new StructType().add("name", "string").add("age", "integ
Dataset[Row] csvDF = spark Dataset[Row] csvDF = spark
.readStream() .readStream()
.option("sep", ";") .option("sep", ";")
.schema(userSchema) // Specify schema of the parquet files .schema(userSchema) // Specify schema of the csv files
.csv("/path/to/directory"); // Equivalent to format("csv").load("/path/to/directory") .csv("/path/to/directory"); // Equivalent to format("csv").load("/path/to/directory")
{% endhighlight %} {% endhighlight %}