Gaurav 46a64d1e0a [SPARK-19304][STREAMING][KINESIS] fix kinesis slow checkpoint recovery ... ## What changes were proposed in this pull request? added a limit to getRecords api call call in KinesisBackedBlockRdd. This helps reduce the amount of data returned by kinesis api call making the recovery considerably faster As we are storing the `fromSeqNum` & `toSeqNum` in checkpoint metadata, we can also store the number of records. Which can later be used for api call. ## How was this patch tested? The patch was manually tested Apologies for any silly mistakes, opening first pull request Author: Gaurav <gaurav@techtinium.com> Closes #16842 from Gauravshah/kinesis_checkpoint_recovery_fix_2_1_0.		2017-03-06 10:41:49 -08:00
..
src	[SPARK-19304][STREAMING][KINESIS] fix kinesis slow checkpoint recovery	2017-03-06 10:41:49 -08:00
pom.xml	[SPARK-19405][STREAMING] Support for cross-account Kinesis reads via STS	2017-02-22 11:32:36 -05:00