Kafka is a distributed streaming platform. Kafka works well as a replacement for a more traditional message broker. Message brokers are used for a variety of reasons (to decouple processing from data producers, to buffer unprocessed messages, and so forth). In comparison to most messaging systems Kafka has better throughput, built-in partitioning, replication, and fault-tolerance, making it a good solution for large scale message processing applications.

A streaming platform has 3 key capabilities:

  1. Publish and subscribe to streams of records, similar to a message queue or enterprise messaging system.

  2. Store streams of records in a fault-tolerant durable way.

  3. Process streams of records as they occur.

Kafka is generally used for 2 broad classes of applications:

  1. Building real-time streaming data pipelines that reliably get data between systems or applications.

  2. Building real-time streaming applications that transform or react to the streams of data.

The following section display Kafka activity:

  • No labels
Terms & Conditions Privacy Statement Cookies Trademarks