79a6e00b76
### What changes were proposed in this pull request? This is a follow up of https://github.com/apache/spark/pull/32961. This PR additionally sets the stack size in `build/mvn`. ### Why are the changes needed? We are still hitting `StackOverflowError` in Jenkins. - https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-3.2/3064/console ``` [INFO] compiling 166 Scala sources and 19 Java sources to /home/jenkins/workspace/spark-master-test-maven-hadoop-3.2/sql/catalyst/target/scala-2.12/classes ... [ERROR] ## Exception when compiling 480 sources to /home/jenkins/workspace/spark-master-test-maven-hadoop-3.2/sql/catalyst/target/scala-2.12/classes java.lang.StackOverflowError ``` This PR increases the JVM of `mvn` instead of the plugin. ``` $ MAVEN_OPTS="-XX:+PrintFlagsFinal" build/mvn clean | grep 'intx ThreadStackSize' intx ThreadStackSize = 2048 {pd product} $ MAVEN_OPTS="-Xss128m -XX:+PrintFlagsFinal" build/mvn clean | grep 'intx ThreadStackSize' intx ThreadStackSize := 131072 {pd product} ``` ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? N/A Closes #33180 from dongjoon-hyun/SPARK-35825. Authored-by: Dongjoon Hyun <dongjoon@apache.org> Signed-off-by: Dongjoon Hyun <dongjoon@apache.org> |
||
|---|---|---|
| .. | ||
| mvn | ||
| sbt | ||
| sbt-launch-lib.bash | ||
| spark-build-info | ||
| util.sh | ||