Skip to main content
P
phanikumarb
February 4, 2021
Question

Kafka Integration/Connectors

  • February 4, 2021
  • 3 replies
  • 0 views

Newbie here. Are there any existing out of box connectors to integrate with Kafka TOPICs? If not please share design patterns/best practices to interact with Kafka components. 

3 replies

josep1835
josep1835
February 14, 2021

Hello Kumar

I remember this was discussed before.

[View:https://community.appian.com/discussions/f/integrations/12646/question-related-to-kafka/75855#75855]

Some thing could have changed, but maybe you can start by sharing little more about your use case. Why you need to connect to Kafka? Are you planning to do big data with appian? Are you planning to use Appian as a producer? Or as a consumer ? Are you planning to do stream? Have you consider micro-batching ?

At the end you can always either consume and API (WSDL), expose a Web API, maybe even connect using JMS, or even create your plugin. But the main thing is to understand what you are trying to do in order for us to provide a good advice.

Thanks

Jose

P
phanikumarbAuthor
February 18, 2021

Jose,

Thanks so much for the response. 

Usecase - APPIAN as both consumer and producer and also we have a streaming need (down the line). 

I don't like the idea of using API, JMS as it is unnecessary overhead. 

I like the plugin idea but In the reference post/discussion above, it was advised against using it as APPIAN uses kafka internally. Can you throw more light on this? If we use plugin to communicate I am not sure why/how it would affect internal configurations. 

dmitry.bocharnikov
dmitry.bocharnikov
Employee
July 13, 2021

Hi, we have just published a Kafka Tools plugin to App Market that may work for you.

community.appian.com/.../kafka-tools

Terms & ConditionsAccessibility statement