You are currently reviewing an older revision of this page.
When trying to initiate some processes in an environment, a 500 - Internal Server Error is displayed.
When checking CPU usage, a single execution engine is found to be running at 100% CPU. Steps to verify are listed below:
top
c
shift+p
<APPIAN_HOME>/server/_bin/k/linux64/k <APPIAN_HOME>/server/_lib/adb
<APPIAN_HOME>/server/process/exec/02/gw1
This issue occurs when one of the below engine performance logs reaches 10 megabytes in size:
These logs can be found in the <APPIAN_HOME>/logs/perflogs directory. These logs will rollover anytime an execution engine is restarted, so this behavior will only manifest if an execution engine has been running for at least 60 days continuously.
<APPIAN_HOME>/logs/perflogs
The reason these logs can cause an execution engine to max out at 100% CPU utilization is a result of how select values in these logs are calculated. Transient tables within the execution engine that populate values in this log become too massive to scale any further, which causes the engine to lock trying to process further data. The reference number for this issue is AN-146311.
To avoid downtime in the environment, moving the above mentioned log files to a directory other than <APPIAN_HOME>/logs/perflogs and restarting the afflicted engine will resolve this issue. The afflicted engine may need to be killed forcibly, and this can be done using the steps below:
Similar to the steps listed in the "Cause" section of this article:
kill -9 <PID>
This section is optional and should only be used as an alternative action if there is a massive technical debt associated with performing the action in the above section for customers (such as upgrading). It can also be used if there is a solution to the issue in the article but is more inconvenient to implement or it causes other undesirable behavior and wouldn’t warrant being an action.
This section includes any relevant version information for Appian or other third/party configurations. Some examples of valid affected versions are as follows:
Last Reviewed: Month YYYY