7d72c073dd
### What changes were proposed in this pull request? At the moment no end-to-end Kafka delegation token test exists which was mainly because of missing embedded KDC. KDC is missing in general from the testing side so I've discovered what kind of possibilities are there. The most obvious choice is the MiniKDC inside the Hadoop library where Apache Kerby runs in the background. What this PR contains: * Added MiniKDC as test dependency from Hadoop * Added `maven-bundle-plugin` because couple of dependencies are coming in bundle format * Added security mode to `KafkaTestUtils`. Namely start KDC -> start Zookeeper in secure mode -> start Kafka in secure mode * Added a roundtrip test (saves and reads back data from Kafka) ### Why are the changes needed? No such test exists + security testing with KDC is completely missing. ### Does this PR introduce any user-facing change? No. ### How was this patch tested? Existing + additional unit tests. I've put the additional test into a loop and was consuming ~10 sec average. Closes #25477 from gaborgsomogyi/SPARK-28760. Authored-by: Gabor Somogyi <gabor.g.somogyi@gmail.com> Signed-off-by: Marcelo Vanzin <vanzin@cloudera.com> |
||
|---|---|---|
| .. | ||
| avro | ||
| docker | ||
| docker-integration-tests | ||
| kafka-0-10 | ||
| kafka-0-10-assembly | ||
| kafka-0-10-sql | ||
| kafka-0-10-token-provider | ||
| kinesis-asl | ||
| kinesis-asl-assembly | ||
| spark-ganglia-lgpl | ||