e4bb97526c
### What changes were proposed in this pull request? This PR fixes the `HybridRowQueue ` to respect the configured memory mode. Besides, this PR also refactored the constructor of `MemoryConsumer` to accept the memory mode explicitly. ### Why are the changes needed? `HybridRowQueue` supports both onHeap and offHeap manipulation. But it inherited the wrong `MemoryConsumer` constructor, which hard-coded the memory mode to `onHeap`. ### Does this PR introduce _any_ user-facing change? No. (Maybe yes in some cases where users can't complete the job before could complete successfully after the fix because of `HybridRowQueue` is able to spill under offHeap mode now. ) ### How was this patch tested? Updated the existing test to make it test both offHeap and onHeap modes. Closes #31152 from Ngone51/fix-MemoryConsumer-memorymode. Authored-by: yi.wu <yi.wu@databricks.com> Signed-off-by: Wenchen Fan <wenchen@databricks.com> |
||
|---|---|---|
| .. | ||
| benchmarks | ||
| src | ||
| pom.xml | ||