spark-instrumented-optimizer/common
Dhruve Ashar 1ebe7ffe07 [SPARK-21181] Release byteBuffers to suppress netty error messages
## What changes were proposed in this pull request?
We are explicitly calling release on the byteBuf's used to encode the string to Base64 to suppress the memory leak error message reported by netty. This is to make it less confusing for the user.

### Changes proposed in this fix
By explicitly invoking release on the byteBuf's we are decrement the internal reference counts for the wrappedByteBuf's. Now, when the GC kicks in, these would be reclaimed as before, just that netty wouldn't report any memory leak error messages as the internal ref. counts are now 0.

## How was this patch tested?
Ran a few spark-applications and examined the logs. The error message no longer appears.

Original PR was opened against branch-2.1 => https://github.com/apache/spark/pull/18392

Author: Dhruve Ashar <dhruveashar@gmail.com>

Closes #18407 from dhruve/master.
2017-06-23 10:36:29 -07:00
..
kvstore [MINOR][BUILD] Fix Java linter errors 2017-06-19 20:17:54 +01:00
network-common [SPARK-21181] Release byteBuffers to suppress netty error messages 2017-06-23 10:36:29 -07:00
network-shuffle [SPARK-20640][CORE] Make rpc timeout and retry for shuffle registration configurable. 2017-06-21 21:54:29 +08:00
network-yarn [SPARK-20756][YARN] yarn-shuffle jar references unshaded guava 2017-05-22 10:10:41 -07:00
sketch [SPARK-20453] Bump master branch version to 2.3.0-SNAPSHOT 2017-04-24 21:48:04 -07:00
tags [SPARK-20453] Bump master branch version to 2.3.0-SNAPSHOT 2017-04-24 21:48:04 -07:00
unsafe [SPARK-20750][SQL] Built-in SQL Function Support - REPLACE 2017-05-29 11:47:31 -07:00