Kafka

Kafka is a distributed streaming platform.

Supported versions

Agent Version Kafka Version
0.1.0+ 1.0+

Install

Follow the instructions in the installation page.

Configuration

# Common agents options described in agent.example.yaml
agent: {}
  # ... snip ...


# Kafka specific configuration.
kafka:
  # Addresses used to locate the kafka services.
  target:
    # Kafka broker configuration.
    broker:
      # Address "host:port" of the kafka broker.
      uri: 'localhost:9092'

      # Network timeout for requests to Kafka.
      timeout: 10

    # Address "host:port" of the JMX server.
    #
    # By default kafka does not expose the JMX server.
    # To do so, set the `JMX_PORT` environment variable before starting the server.
    # For additional options see:
    #   https://github.com/apache/kafka/blob/1.1.1/bin/kafka-run-class.sh#L166-L174
    jmx: 'localhost:9999'

    # Zookeeper ensemble for the Kafka cluster.
    zookeeper:
      # Addresses "host:port" of the zookeeper ensemble.
      uri: 'localhost:2181'

      # Zookeeper session timeout.
      timeout: 10

Upgrades notes

See the full changelog for all details.