SP-4042 KB - XXXX Engines fail to start following hotfix deployment or upgrade to Appian versions 19.2 - 19.4

Symptoms

Appian Engines fail to start following a hotfix deployment or version upgrade due to transaction replay error with the following message in the service_manager.log:

ERROR com.appian.komodo.translog.OutstandingRequestsTracker - Outstanding write requests was decremented again after the all writes logged event.

Cause

This is due to a bad Service Manager version on the following Appian build versions:

19.4.76.0 to 19.4.89.0
19.3.130.0 to 19.3.141.0
19.2.196.0 to 19.2.208.0

Action

Please reach out to Appian Support to receive the fix for this issue and follow the instructions below to apply the fix:

Unzip the file provided by Appian Support into a safe location that is not <APPIAN_HOME>.
Shutdown all components of Appian gracefully
Rename <APPIAN_HOME>/services/bin to <APPIAN_HOME>/services/bin_backup
Rename <APPIAN_HOME>/services/lib to <APPIAN_HOME>/services/lib_backup
From the unzipped download, copy the ‘bin’ directory into <APPIAN_HOME>/services
From the unzipped download, copy the ‘lib’ directory into <APPIAN_HOME>/services
Start Service Manager, ZooKeeper, and Kafka on all engine nodes using <APPIAN_HOME>/services/start.bat|sh -p PASSWORD -s all
Stop Service Manager, ZooKeeper and Kafka on all engine nodes using <APPIAN_HOME>/services/stop.bat|sh -p PASSWORD -s all
Start Appian normally using the steps provided in our Starting and Stopping Appian documentation

Once your environment is running with the patch successfully applied, your environment should once again be in a stable state.

Please proceed to perform cleanup by:

Removing <APPIAN_HOME>/services/bin_backup
Removing <APPIAN_HOME>/services/lib_backup
Removing the downloaded komodo-1.236.0.zip and its unzipped contents that are in the safe location

Affected Versions

This article applies to Appian build versions:

19.4.76.0 to 19.4.89.0
19.3.130.0 to 19.3.141.0
19.2.196.0 to 19.2.208.0