6dae11d034
### What changes were proposed in this pull request? Scrip Transform no-serde (`ROW FORMAT DELIMITED`) mode `LINE TERMINNATED BY ` only support `\n`. Tested in hive : Hive 1.1 ![image](https://user-images.githubusercontent.com/46485123/90309510-ce82a180-df1b-11ea-96ab-56e2b3229489.png) Hive 2.3.7 ![image](https://user-images.githubusercontent.com/46485123/90309504-c88cc080-df1b-11ea-853e-8f65e9ed2375.png) ### Why are the changes needed? Strictly limit the use method to ensure the accuracy of data ### Does this PR introduce _any_ user-facing change? User use Scrip Transform no-serde (ROW FORMAT DELIMITED) mode with `LINE TERMINNATED BY ` not equal `'\n'`. will throw error ### How was this patch tested? Added UT Closes #29438 from AngersZhuuuu/SPARK-32607. Authored-by: angerszhu <angers.zhu@gmail.com> Signed-off-by: Wenchen Fan <wenchen@databricks.com> |
||
---|---|---|
.. | ||
benchmarks | ||
src | ||
v1.2/src | ||
v2.3/src | ||
pom.xml |