Protocol

Kafka message attributes.

A Kafka broker consists of a node id, host name and TCP port.

A client id.

Byte flag indicating compression codec in use.

The id of the consumer group (same as GroupId).

MemberAssignment for the consumer group protocol. Each member in the group will receive the assignment from the leader in the sync group response.

ProtocolMetadata for the consumer group protocol.

A Kafka group coordinator host name.

A Kafka group coordinator id.

A Kafka group coordinator TCP port.

A correlation id of a Kafka request-response transaction.

Raised when the received message CRC32 is different from the computed CRC32.

Crc digest of a Kafka message.

A Kafka error code.

The offset to begin this fetch from.

First offset in an AbortedTransaction

An id of a Kafka group protocol generation.

The offsets for a given consumer group are maintained by a specific broker called the group coordinator. i.e., a consumer needs to issue its offset commit and fetch requests to this specific broker. It can discover the current coordinator by issuing a group coordinator request. Can be routed to any node in the bootstrap list.

A Kafka group id.

Sent by a consumer to the group coordinator.

Heartbeat response from the group coordinator.

The offset at the end of the log for this partition. This can be used by the client to determine how many messages behind the end of the log they are.

A Kafka host name.

This controls visibility of transactional records. If set to 0, makes all records visible. If set to 1, separates aborted transactions so they can be discarded.

Node ids of in-sync replicas.

A Kafka message key (bytes).

The last offset such that the state of all transactional records prior to this offset have been decided (ABORTED or COMMITTED)

The id of the leader node.

The id of a group leader.

An explicit request to leave a group. Preferred over session timeout.

The earliest available offset for a partition.

The maximum bytes to include in the message set for this partition. This helps bound the size of the response.

The max wait time is the maximum amount of time in milliseconds to block waiting if insufficient data is available at the time the request is issued.

A byte[] representing member assignment of a particular Kafka group protocol.

Metadata associated with a Kafka group member.

A Kafka message type used for producing and fetching.

The size, in bytes, of the message set that follows.

The size of a Kafka message.

Raised when the message is bigger than the message set and therefore can't be received.

Request metadata on all or a specific set of topics. Can be routed to any node in the bootstrap list.

Contains a list of all brokers (node id, host, post) and assignment of topic/partitions to brokers. The assignment consists of a leader, a set of replicas and a set of in-sync replicas.

This is the minimum number of bytes of messages that must be available to give a response.

An id of a Kafka node.

A Kafka topic offset.

A request to return offset information for a set of topics on a specific replica.

A Kafka host port number

A reponse to a produce request.

Producer id associated with an AbortedTransaction

The replica id indicates the node id of the replica initiating this request. Normal client consumers should always specify this as -1.

Node ids of replicas.

A Kafka request envelope.

A Kafka request message.

This field indicates how many acknowledgements the servers should receive before responding to the request.

A Kafka response envelope.

A Kafka response message.

The sync group request is used by the group leader to assign state (e.g. partition assignments) to all members of the current generation. All members send SyncGroup immediately after joining the group, but only the leader provides the group's assignment.

Duration in milliseconds for which the request was throttled due to quota violation.

Used to ask for all messages before a certain time (ms).

This provides a maximum time in milliseconds the server can await the receipt of the number of acknowledgements in RequiredAcks.

The timestamp of a message.

Metadata for a specific topic consisting of a set of partition-to-broker assignments.

A name of a Kafka topic.

A Kafka message value (bytes).