be6d39c379
## What changes were proposed in this pull request? In File source V1, the statistics of `HadoopFsRelation` is `compressionFactor * sizeInBytesOfAllFiles`. To follow it, we can implement the interface SupportsReportStatistics in FileScan and report the same statistics. ## How was this patch tested? Unit test Closes #24571 from gengliangwang/stats. Authored-by: Gengliang Wang <gengliang.wang@databricks.com> Signed-off-by: Wenchen Fan <wenchen@databricks.com> |
||
---|---|---|
.. | ||
benchmarks | ||
src | ||
v1.2.1/src | ||
v2.3.4/src | ||
pom.xml |