0f48aafab8
### What changes were proposed in this pull request? This PR proposes: 1. Use `is.data.frame` to check if it is a DataFrame. 2. to install Arrow and test Arrow optimization in AppVeyor build. We're currently not testing this in CI. ### Why are the changes needed? 1. To support SparkR with Arrow 0.14 2. To check if there's any regression and if it works correctly. ### Does this PR introduce any user-facing change? ```r df <- createDataFrame(mtcars) collect(dapply(df, function(rdf) { data.frame(rdf$gear + 1) }, structType("gear double"))) ``` **Before:** ``` Error in readBin(con, raw(), as.integer(dataLen), endian = "big") : invalid 'n' argument ``` **After:** ``` gear 1 5 2 5 3 5 4 4 5 4 6 4 7 4 8 5 9 5 ... ``` ### How was this patch tested? AppVeyor Closes #25993 from HyukjinKwon/arrow-r-appveyor. Authored-by: HyukjinKwon <gurwls223@apache.org> Signed-off-by: HyukjinKwon <gurwls223@apache.org>
65 lines
1.5 KiB
Plaintext
65 lines
1.5 KiB
Plaintext
Package: SparkR
|
|
Type: Package
|
|
Version: 3.0.0
|
|
Title: R Front End for 'Apache Spark'
|
|
Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>.
|
|
Authors@R: c(person("Shivaram", "Venkataraman", role = c("aut", "cre"),
|
|
email = "shivaram@cs.berkeley.edu"),
|
|
person("Xiangrui", "Meng", role = "aut",
|
|
email = "meng@databricks.com"),
|
|
person("Felix", "Cheung", role = "aut",
|
|
email = "felixcheung@apache.org"),
|
|
person(family = "The Apache Software Foundation", role = c("aut", "cph")))
|
|
License: Apache License (== 2.0)
|
|
URL: https://www.apache.org/ https://spark.apache.org/
|
|
BugReports: https://spark.apache.org/contributing.html
|
|
SystemRequirements: Java (>= 8, < 12)
|
|
Depends:
|
|
R (>= 3.1),
|
|
methods
|
|
Suggests:
|
|
knitr,
|
|
rmarkdown,
|
|
testthat,
|
|
e1071,
|
|
survival,
|
|
arrow
|
|
Collate:
|
|
'schema.R'
|
|
'generics.R'
|
|
'jobj.R'
|
|
'column.R'
|
|
'group.R'
|
|
'RDD.R'
|
|
'pairRDD.R'
|
|
'DataFrame.R'
|
|
'SQLContext.R'
|
|
'WindowSpec.R'
|
|
'backend.R'
|
|
'broadcast.R'
|
|
'catalog.R'
|
|
'client.R'
|
|
'context.R'
|
|
'deserialize.R'
|
|
'functions.R'
|
|
'install.R'
|
|
'jvm.R'
|
|
'mllib_classification.R'
|
|
'mllib_clustering.R'
|
|
'mllib_fpm.R'
|
|
'mllib_recommendation.R'
|
|
'mllib_regression.R'
|
|
'mllib_stat.R'
|
|
'mllib_tree.R'
|
|
'mllib_utils.R'
|
|
'serialize.R'
|
|
'sparkR.R'
|
|
'stats.R'
|
|
'streaming.R'
|
|
'types.R'
|
|
'utils.R'
|
|
'window.R'
|
|
RoxygenNote: 5.0.1
|
|
VignetteBuilder: knitr
|
|
NeedsCompilation: no
|