Kafka Tools

RE: Kafka Tools

Appian AppMarket — Fri, 27 Feb 2026 23:00:00 GMT

1.7.0 Release Notes

New Features: New Smart Service Consume From Kafka JWT Auth Grant. This Smart Service implements a Kafka Consumer that authenticates using the OAuth 2.0 JWT Bearer Authorization Grant as defined in RFC 7523.
Bug Fixes: Ensure connection rollback upon encountering exception

RE: Kafka Tools

Patricia — Thu, 18 Dec 2025 14:35:15 GMT

Hi team,

We need this plug-in to support AVRO Confluent Cloud Schema Registry for our use case. We’ve seen that in the latest release this functionality was added to the Consume From Kafka smart service via the avroSchemaRegistryUrl parameter.

Is there any plan to add the same functionality to the Publish To Kafka smart service in the near future, so Schema Registry is supported for both consuming and publishing?

Thanks in advance!

RE: Kafka Tools

mollyfarnam — Wed, 10 Dec 2025 18:16:35 GMT

Good afternoon -

We are frequently receiving this error from the Consumer process for this plugin:

The incoming tabular data stream (TDS) protocol stream is incorrect. The TDS headers contained errors.;

It just errors out but then everything picks up just fine on the next run. Our process runs every 10 minutes and we get 10-15 where this error pops up each day. Please advise how we can fix this error, thanks!

RE: Kafka Tools

Appian AppMarket — Thu, 04 Dec 2025 23:00:00 GMT

v1.6.0 Release Notes

avroSchemaRegistryUrl: URL for the API endpoint for AVRO schema registry. If certificate is needed, it must be contained in truststore and keystore configuration. If specified, all topics configured to decode (consume) must be in AVRO format (no mixing of topics formats). To receive mixed format topics, 2 PM nodes needs to be configured - one for String based topics and one for Avro based topics.

RE: Kafka Tools

Appian AppMarket — Fri, 07 Nov 2025 23:00:01 GMT

v1.5.2 Release Notes

Support a new parameter `scope` on both Smart Services to enable OAuth with IdPs that require a scope parameter to be provided (e.g. EntraID).
Updated kafka-clients library.

RE: Kafka Tools

gokulnath.sudharsun — Fri, 12 Sep 2025 10:24:10 GMT

hello everyone! I am Gokulnath - PM for the Native Kafka Integration initiative in Appian. The beta for the native event consumption capability is now live until the Dec of this year. Hence I encourage you to try out this capability and share feedback. Please follow the instructions in this community link to participate in the beta : [mention:33c7337cb9784429bcdbf4105df90226:f7d226abd59f475c9d224a79e3f0ec07] Happy to answer any questions, thank you.

RE: Kafka Tools

klaaspieterb0001 — Wed, 20 Aug 2025 06:22:56 GMT

Are there plans to support non-Text values like Avro messages?

One options is to define a custom (De)serializer class, but this seem not to be used if you define this.. To code seems to assume the value is always a String. is the support for a customer Deserializer class with non-text values really supported?

RE: Kafka Tools

sundarrajj0474 — Fri, 01 Aug 2025 08:02:59 GMT

[mention:92ac9d4559ff43edb28eaa01ed77691b:e9ed411860ed4f2ba0265705b8793d05] , In the plugin Third-Party Credentials, Scope field missing / not possible to configure, due to that token generation is failing , is that possible to upgrade the plugin with Scope field.

RE: Kafka Tools

mollyfarnam — Wed, 28 May 2025 20:09:46 GMT

We are able to successfully produce messages to Kafka, but have need for the message to use a Json Serializer. Is it possible to add the ability to use a different serializer than just String serializer when producing messages?

RE: Kafka Tools

mirunas306530 — Wed, 21 May 2025 07:55:53 GMT

We have an issue consuming messages from one topic.

We use 2 consumers with same configuration (test and acc) to consume from same topic. TEST consumed 2 messages and ACC consumed 3 messages. Both consumers are alive on the topic and have lag 0. Any ideas what could have gone wrong ? Also, any logs where I could check something about what is consumed ?

We've been using this plugin successfully for the past 2 years to consume from other topics but this has happened twice in past month with a new topic.

v1.4.2

Thanks

RE: Kafka Tools

joeys987 — Fri, 04 Apr 2025 14:54:01 GMT

We successfully integrated the Kafka tool in our dev environment. We're now looking to integrate it in our other environments. The Kafka tool requires the setup of third-party credentials. We use Salt Stack to set up all our environments. Is it possible to set up the Kafka Tool third party credentials using Salt? Thanks

RE: Kafka Tools

Appian AppMarket — Thu, 13 Feb 2025 23:00:00 GMT

v1.4.3 Release Notes

Upgraded kafka-clients library

RE: Kafka Tools

Shanmukha — Mon, 13 Jan 2025 19:50:08 GMT

Hello,

We are using 1.2.1 version plugin. Recently appian cloud version got updated with 24.4 version. From there onwards it is throwing below error.

ERROR com.appiancorp.cs.plugin.kafka.consumer.AppianKafkaConsumerThread - Received an exception from consumer: 1177940 - SSL handshake failed

Could any one please help on this on urgent basis.?

Thank you in advance.!

RE: Kafka Tools

Jones Prakash Selvaraj — Tue, 20 Aug 2024 09:40:35 GMT

Hi,

We are currently using the 1.4.1 version of this plugin, and it's working as expected. We are planning on upgrading a separate Kafka cluster from 2.6.2 to 2.8.2.tiered version (Supported Apache Kafka versions - Amazon Managed Streaming for Apache Kafka). Do you have information on the compatible versions of the Kafka components that support this plugin?

RE: Kafka Tools

JJ Cañas — Tue, 30 Jul 2024 15:02:32 GMT

Hi,

Does anyone know how this plug-in works? I mean, in what format does it publish messages to Kafka and how does it save the data in the database.

As my colleague Patricia says below, we need to use Schema Registry to serialize and deserialize messages in AVRO format. Can this be done with this plug-in?

I've seen in the documentation that Consume from Kafka Smart Service has an input parameter called "Deserializer Class Name" but Publish to Kafka Smart Service hasn't any input parameter related to serialization. Does this mean that the plugin serializes the messages in some way? You can provide it the Java class to use for deserialization but not how it should serialize the messages to publish to Kafka? This is really confusing.

Thanks in advance.