a838699ee0
### What changes were proposed in this pull request? Add Java/Scala StructuredKerberizedKafkaWordCount examples to test kerberized kafka. ### Why are the changes needed? Now,`StructuredKafkaWordCount` example is not support to visit kafka using kerberos authentication. ### Does this PR introduce any user-facing change? No ### How was this patch tested? ``` Yarn client: $ bin/run-example --files ${jaas_path}/kafka_jaas.conf,${keytab_path}/kafka.service.keytab \ --driver-java-options "-Djava.security.auth.login.config=${path}/kafka_driver_jaas.conf" \ --conf \ "spark.executor.extraJavaOptions=-Djava.security.auth.login.config=./kafka_jaas.conf" \ --master yarn sql.streaming.StructuredKerberizedKafkaWordCount broker1-host:port,broker2-host:port \ subscribe topic1,topic2 Yarn cluster: $ bin/run-example --files \ ${jaas_path}/kafka_jaas.conf,${keytab_path}/kafka.service.keytab,${krb5_path}/krb5.conf \ --driver-java-options \ "-Djava.security.auth.login.config=./kafka_jaas.conf \ -Djava.security.krb5.conf=./krb5.conf" \ --conf \ "spark.executor.extraJavaOptions=-Djava.security.auth.login.config=./kafka_jaas.conf" \ --master yarn --deploy-mode cluster \ sql.streaming.StructuredKerberizedKafkaWordCount broker1-host:port,broker2-host:port \ subscribe topic1,topic2 ``` Closes #25649 from hddong/Add-StructuredKerberizedKafkaWordCount-examples. Lead-authored-by: hongdd <jn_hdd@163.com> Co-authored-by: hongdongdong <hongdongdong@cmss.chinamobile.com> Signed-off-by: HyukjinKwon <gurwls223@apache.org> |
||
---|---|---|
.. | ||
src/main | ||
pom.xml |