SP-3079 DRAFT KB-XXXX Kafka Replicas Out of Sync in High Availability

Symptoms

One of the Kafka Brokers goes out of sync in the High Availability setup. The output of the Status script contains the following:

Kafka Broker Connectivity ----------------------------------------------------
example1.com:9092 Reachable ISR: All replicas in sync 
example2.com:9092 Reachable controller ISR: Replicas not in sync
 not in sync: __consumer_offsets-0
 not in sync: __consumer_offsets-12
 not in sync: __consumer_offsets-15
 not in sync: __consumer_offsets-18
 not in sync: __consumer_offsets-21 
 not in sync: serviceManager.transaction.download-stats-0
 not in sync: serviceManager.transaction.execution01-0
 not in sync: serviceManager.transaction.execution02-0
 not in sync: serviceManager.transaction.portal-0 
example3.com:9092 Reachable ISR: All replicas in sync

Cause

This issue has been addressed via AN-141918 in the following hotfixes/versions:

• 19.3 Hotfix Package C
• 19.2 Hotfix Package E

Action

Apply the latest hotfix to your Appian installation or upgrade to the latest version of Appian.

Workaround

1. Stop and Start Kafka broker on example1.com
2. Stop and Start Kafka broker on example2.com
3. Stop and Start Kafka broker on example3.com (Controller)

Please ensure to Stop and Start Kafka on Controller last 

Affected Versions

This article applies to Appian 19.3 and earlier.