Kafka Tools

Overview

KafkaTools provides the following functionality that allows publishing to and consuming from topics on Kafka Servers.

Smart Services

  • Publish To Kafka
  • Consume From Kafka

In order to process the messages consumed from Kafka, it is recommended to use the Transaction Manager application. The models designed to process messages will be configured an assigned through the transaction manager job types. See documentation for Transaction Manager

Key Features & Functionality

Please refer to the README for additional details.

Anonymous
Parents
  • Hi,

    We are using the 1.4.1 version and have set up of 20-minute runtime. 

    For topics, we are passing the expression rule as input. Values returning in the expression rule output may vary dynamically (due to some custom processes we have configured in the backend).

    But the already active "consume from Kafka" smart service keeps on consuming the topics that were set at the start. It is not considering the value changes in real-time. Is this the expected behaviour?

Comment
  • Hi,

    We are using the 1.4.1 version and have set up of 20-minute runtime. 

    For topics, we are passing the expression rule as input. Values returning in the expression rule output may vary dynamically (due to some custom processes we have configured in the backend).

    But the already active "consume from Kafka" smart service keeps on consuming the topics that were set at the start. It is not considering the value changes in real-time. Is this the expected behaviour?

Children
  • Hi,

    I think so, that is the expected behavior. It seems that, when the smart service starts, it subscribes to the topic that is passed to it as input at that moment. In fact, I have detected that, if we force the subscription to a topic to be cut, canceling the process model that that consumer has, the subscription is NOT cut until the "Runtime in minutes" period ends, in my case , set to 58 minutes. You can see this fact by consulting the log "tomcat-stdOut.log"