Hossein 9514b822a7 [SPARK-29777][SPARKR] SparkR::cleanClosure aggressively removes a function required by user function ... ### What changes were proposed in this pull request? The implementation for walking through the user function AST and picking referenced variables and functions, had an optimization to skip a branch if it had already seen it. This runs into an interesting problem in the following example ``` df <- createDataFrame(data.frame(x=1)) f1 <- function(x) x + 1 f2 <- function(x) f1(x) + 2 dapplyCollect(df, function(x) { f1(x); f2(x) }) ``` Results in error: ``` org.apache.spark.SparkException: R computation failed with Error in f1(x) : could not find function "f1" Calls: compute -> computeFunc -> f2 ``` ### Why are the changes needed? Bug fix ### Does this PR introduce any user-facing change? No ### How was this patch tested? Unit tests in `test_utils.R` Closes #26429 from falaki/SPARK-29777. Authored-by: Hossein <hossein@databricks.com> Signed-off-by: HyukjinKwon <gurwls223@apache.org>		2019-11-19 09:04:59 +09:00
..
fulltests	[SPARK-29777][SPARKR] SparkR::cleanClosure aggressively removes a function required by user function	2019-11-19 09:04:59 +09:00
run-all.R	[SPARK-25572][SPARKR] test only if not cran	2018-09-29 14:48:32 -07:00