2014-09-03 20:38:01 -04:00
|
|
|
---
|
|
|
|
layout: global
|
|
|
|
title: Spark Streaming + Kafka Integration Guide
|
2019-03-30 20:49:45 -04:00
|
|
|
license: |
|
|
|
|
Licensed to the Apache Software Foundation (ASF) under one or more
|
|
|
|
contributor license agreements. See the NOTICE file distributed with
|
|
|
|
this work for additional information regarding copyright ownership.
|
|
|
|
The ASF licenses this file to You under the Apache License, Version 2.0
|
|
|
|
(the "License"); you may not use this file except in compliance with
|
|
|
|
the License. You may obtain a copy of the License at
|
|
|
|
|
|
|
|
http://www.apache.org/licenses/LICENSE-2.0
|
|
|
|
|
|
|
|
Unless required by applicable law or agreed to in writing, software
|
|
|
|
distributed under the License is distributed on an "AS IS" BASIS,
|
|
|
|
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
|
|
See the License for the specific language governing permissions and
|
|
|
|
limitations under the License.
|
2014-09-03 20:38:01 -04:00
|
|
|
---
|
|
|
|
|
2018-10-16 10:10:24 -04:00
|
|
|
[Apache Kafka](https://kafka.apache.org/) is publish-subscribe messaging rethought as a distributed, partitioned,
|
|
|
|
replicated commit log service. Please read the [Kafka documentation](https://kafka.apache.org/documentation.html)
|
|
|
|
thoroughly before starting an integration using Spark.
|
2016-08-05 05:13:32 -04:00
|
|
|
|
2018-10-16 10:10:24 -04:00
|
|
|
At the moment, Spark requires Kafka 0.10 and higher. See
|
|
|
|
<a href="streaming-kafka-0-10-integration.html">Kafka 0.10 integration documentation</a> for details.
|