Information
  • Author: Appian Corporation
  • Type: Plug-in (Function & Smart Service)
  • Support: This plug-in or utility is not supported by the author. The content is free to use with a licensed product, but it is made available as-is and Community supported.
  • Industry: All Industries
  • Compatible Version(s): 23.2
  • First Released:
  • Last Updated:
  • Cost: Free
Resources
Share
Home » AppMarket » Kafka Tools

Kafka Tools

Overview

KafkaTools provides the following functionality that allows publishing to and consuming from topics on Kafka Servers.

Smart Services

  • Publish To Kafka
  • Consume From Kafka

In order to process the messages consumed from Kafka, it is recommended to use the Transaction Manager application. The models designed to process messages will be configured an assigned through the transaction manager job types. See documentation for Transaction Manager

Key Features & Functionality

Please refer to the README for additional details.

Anonymous
Parents

  • How to set-up "Data Source Name" and "Transaction Table Name"?

    For "Data Source Name":

            -  I have create a dummy table along with data type & data store & Record Type, since the type is text, I have tried put the table name, data store name, even recordtype, non of them working

    For "Transaction Table Name":

            -  Since it default linked to "tm_job_transaction", I tried leave there also tried use the table I created, nether of them work.

    When I run the PM, it do give me success, however nothing received, no message, no table got updated.

Comment

  • How to set-up "Data Source Name" and "Transaction Table Name"?

    For "Data Source Name":

            -  I have create a dummy table along with data type & data store & Record Type, since the type is text, I have tried put the table name, data store name, even recordtype, non of them working

    For "Transaction Table Name":

            -  Since it default linked to "tm_job_transaction", I tried leave there also tried use the table I created, nether of them work.

    When I run the PM, it do give me success, however nothing received, no message, no table got updated.

Children
  • in reply to gavins5922

    Hi, 

    For the "Data Source Name", it's indeed the name of your business data source (the same name from Data source in Admin Console).

    For the "Transaction Table Name", if you use a custom table instead of the tm_job_transaction, your table must have the same structure.

    Oracle exemple : 

    ID (Number)

    JOB_TYPE_ID (Number) - controlled by a sequence for auto-increment

    CONTEXT_JSON (varchar2)

    SCHEDULED_DATE (Timestamp)

    STATUS_ID (Number)

    TOPIC (varchar2)

    PARTITION (Number)

    OFFSET (Number)

    KEY (Varchar2)

    And yes, we success to retrieve kafka messages with this plug-in.

    Regards

  • in reply to Miguel Galán

    Hi Miguel Galán,

    Much appreciate for helping! Yep, as I update to "jdbc/Appian" at least it give me some error message.

    Right now it saying "Failed to construct kafka consumer". 

    Did you successfully subscribe from Kafka via this plug-in?

    Thank you so much!

    Best Regards

  • in reply to gavins5922

    Hi gavins5922,

    For "Data Source Name":

    You have to include the JDBC of your database in Text type, not the table. Example: "jdbc/Appian" (if you have no other Data Source configured, this is the default Data Source)

    For "Transaction Table Name":

    I haven't tried this, I use the "tm_job_transaction" table but does the table you are setting up have the same columns as tm_job_transaction? I guess if it has the same structure, it should work...

    Hope this help you

    Best regards

© 2024 Appian. All rights reserved.