0f48aafab8
### What changes were proposed in this pull request?
This PR proposes:
1. Use `is.data.frame` to check if it is a DataFrame.
2. to install Arrow and test Arrow optimization in AppVeyor build. We're currently not testing this in CI.
### Why are the changes needed?
1. To support SparkR with Arrow 0.14
2. To check if there's any regression and if it works correctly.
### Does this PR introduce any user-facing change?
```r
df <- createDataFrame(mtcars)
collect(dapply(df, function(rdf) { data.frame(rdf$gear + 1) }, structType("gear double")))
```
**Before:**
```
Error in readBin(con, raw(), as.integer(dataLen), endian = "big") :
invalid 'n' argument
```
**After:**
```
gear
1 5
2 5
3 5
4 4
5 4
6 4
7 4
8 5
9 5
...
```
### How was this patch tested?
AppVeyor
Closes #25993 from HyukjinKwon/arrow-r-appveyor.
Authored-by: HyukjinKwon <gurwls223@apache.org>
Signed-off-by: HyukjinKwon <gurwls223@apache.org>
65 lines
1.5 KiB
Plaintext
65 lines
1.5 KiB
Plaintext
Package: SparkR
|
|
Type: Package
|
|
Version: 3.0.0
|
|
Title: R Front End for 'Apache Spark'
|
|
Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>.
|
|
Authors@R: c(person("Shivaram", "Venkataraman", role = c("aut", "cre"),
|
|
email = "shivaram@cs.berkeley.edu"),
|
|
person("Xiangrui", "Meng", role = "aut",
|
|
email = "meng@databricks.com"),
|
|
person("Felix", "Cheung", role = "aut",
|
|
email = "felixcheung@apache.org"),
|
|
person(family = "The Apache Software Foundation", role = c("aut", "cph")))
|
|
License: Apache License (== 2.0)
|
|
URL: https://www.apache.org/ https://spark.apache.org/
|
|
BugReports: https://spark.apache.org/contributing.html
|
|
SystemRequirements: Java (>= 8, < 12)
|
|
Depends:
|
|
R (>= 3.1),
|
|
methods
|
|
Suggests:
|
|
knitr,
|
|
rmarkdown,
|
|
testthat,
|
|
e1071,
|
|
survival,
|
|
arrow
|
|
Collate:
|
|
'schema.R'
|
|
'generics.R'
|
|
'jobj.R'
|
|
'column.R'
|
|
'group.R'
|
|
'RDD.R'
|
|
'pairRDD.R'
|
|
'DataFrame.R'
|
|
'SQLContext.R'
|
|
'WindowSpec.R'
|
|
'backend.R'
|
|
'broadcast.R'
|
|
'catalog.R'
|
|
'client.R'
|
|
'context.R'
|
|
'deserialize.R'
|
|
'functions.R'
|
|
'install.R'
|
|
'jvm.R'
|
|
'mllib_classification.R'
|
|
'mllib_clustering.R'
|
|
'mllib_fpm.R'
|
|
'mllib_recommendation.R'
|
|
'mllib_regression.R'
|
|
'mllib_stat.R'
|
|
'mllib_tree.R'
|
|
'mllib_utils.R'
|
|
'serialize.R'
|
|
'sparkR.R'
|
|
'stats.R'
|
|
'streaming.R'
|
|
'types.R'
|
|
'utils.R'
|
|
'window.R'
|
|
RoxygenNote: 5.0.1
|
|
VignetteBuilder: knitr
|
|
NeedsCompilation: no
|