Kafka Tools

Overview

KafkaTools provides the following functionality that allows publishing to and consuming from topics on Kafka Servers.

Smart Services

  • Publish To Kafka
  • Consume From Kafka

In order to process the messages consumed from Kafka, it is recommended to use the Transaction Manager application. The models designed to process messages will be configured an assigned through the transaction manager job types. See documentation for Transaction Manager

Key Features & Functionality

Please refer to the README for additional details.

Anonymous
Parents
  • Hi,

    We are trying to use this plug-in to consume and publish from Kafka with Schema Registry from Confluent Cloud.

    This plug-in does not support AVRO format in Confluent's Schema Registry, so we're evaluating if we could solve this by creating a Smart Service Plug-in to serialize/deserialize with the AVRO Java libraries.

    The idea is to serialize the messages before using Publish to Kafka and then deserialize the data after Consume from Kafka stores them in db.

    Does anyone know if this Smart services can send and receive the binary in AVRO format? Has anyone tried to do this or something similar?

    Thanks in advance

Comment
  • Hi,

    We are trying to use this plug-in to consume and publish from Kafka with Schema Registry from Confluent Cloud.

    This plug-in does not support AVRO format in Confluent's Schema Registry, so we're evaluating if we could solve this by creating a Smart Service Plug-in to serialize/deserialize with the AVRO Java libraries.

    The idea is to serialize the messages before using Publish to Kafka and then deserialize the data after Consume from Kafka stores them in db.

    Does anyone know if this Smart services can send and receive the binary in AVRO format? Has anyone tried to do this or something similar?

    Thanks in advance

Children
No Data