7895ea1f50
### What changes were proposed in this pull request? The Kafka offset reader which uses `AdminClient` still uses `UninterruptibleThread` to call it. Since there is no evidence that `AdminClient` suffers from similar issues like [KAFKA-1894](https://issues.apache.org/jira/browse/KAFKA-1894) I'm removing `UninterruptibleThread` usage. In order to put the `AdminClient` under stress and make sure it works I've created the following standalone application: https://github.com/gaborgsomogyi/kafka-admin-interruption What this PR contains: * Removed `UninterruptibleThread` from `KafkaOffsetReaderAdmin` * Removed/modified comments which are not true * Adapted `KafkaRelationSuite` * Renamed `partitionsAssignedToConsumer` to `partitionsAssignedToAdmin` ### Why are the changes needed? `KafkaOffsetReaderAdmin` doesn't need `UninterruptibleThread` usage. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Existing unit tests + manually with simple Kafka to Kafka query. Closes #30668 from gaborgsomogyi/SPARK-32910. Authored-by: Gabor Somogyi <gabor.g.somogyi@gmail.com> Signed-off-by: Jungtaek Lim (HeartSaVioR) <kabhwan.opensource@gmail.com> |
||
|---|---|---|
| .. | ||
| avro | ||
| docker | ||
| docker-integration-tests | ||
| kafka-0-10 | ||
| kafka-0-10-assembly | ||
| kafka-0-10-sql | ||
| kafka-0-10-token-provider | ||
| kinesis-asl | ||
| kinesis-asl-assembly | ||
| spark-ganglia-lgpl | ||