How to Consume Data from Kafka to appian application?

Dinesh Kumar

Certified Associate Developer

over 2 years ago

Hi Guys,

I had a requirement that my Appian Application needs to consume data from Kafka.

For this i have added a Plug-in called (Kafka tool). It contains 2 smart services.

1. Consume from Kafka.

2. Publish To Kafka.

So, i used Consume from Kafka Node in my process model. In data tab there are following Node inputs and node outputs to configure.

Node Inputs:

Servers * (Text)

Data Source Name * (Text)

Transaction Table Name * (Text)

Security Protocol * (Text)

Secure Credentials Store Key (Text)

S A S L Mechanism (Text)

Group Id * (Text)

Num Consumers * (Number (Integer))

Topic * (Text)

Job Type Id * (Number (Integer))

Runtime In Minutes * (Number (Integer))

Polling Interval In Ms * (Number (Integer))

Sleeping Interval In Ms * (Number (Integer))

Session Timeout (Number (Integer))

Deserializer Class Name (Text)

Message Filter (Text)

Key Store (Document)

Trust Store (Document)

Node Outputs:

Success (Boolean)

Error Message (Text)

Above Highlighted fields are mandatory fields.

My Doubts:

Do we need to use integration to connect with Kafka? or Not needed as we already have smart services to connect with external System.
If Integration is not required then in node outputs the data coming from node is a BOOLEAN type. So, How can we get the data?
Can anyone guide me with the procedure to consume data from Kafka with sample node inputs and node outputs.
If the procedure i have followed till now was wrong. Please feel free to give your suggestions to achieve my task.
Do i need to do any further Configurations?

Discussion posts and replies are publicly visible

Parents

Reply

Children

No Data