Process instances and checkpoints

Question

As I understand, process instances live in RAM until they are saved to disk, and this operation is performed at checkpoints. Questions: what happens to process instances if Appian experiences a sudden shutdown (e.g. due to a power loss in an on premise scenario)? I imagine that instances would be recreated in the exact state they were at the last checkpoint, is this correct? Other than customizing checkpoint intervals, is there a way to force checkpoints for a particular node inside a process model, if I want my instance to be saved to disk at a particular moment? 
 
 Thanks.

Peter Lewis · Accepted Answer

This is not entirely true - process instances live in memory until they are archived . You can set an archival policy to archive your process instance data a certain number of days after the process is completed or canceled. 
 I think it's useful to discuss a bit more about how Appian engines work. In Appian, we have a bunch of different kinds of engines that store data related to running Appian. For example, we have engines related to documents (content engine), users (personalization engine), processes (process exec and analytics engines), etc. The main engine you're talking about above is the process execution engine, which stores information about each in-flight process. 
 There are also two main parts to the engine: the in-memory database that stores your data and a .kdb file that is saved to disk. The .kdb file consists of a snapshot of the database and a transaction file. It's important to note that any transaction that occurs in Appian will write to both the in memory database and the transaction log in the .kdb file. This way, even if there is a sudden shutdown, we still have all the transactions saved to disk (so we can replay all the transactions to get the database to its proper state). 
 However, as you can imagine the transaction log can get to be quite large. If we actually did need to replay all the transactions from the beginning, it could take quite a while. So, this is where we use checkpointing. The purpose of checkpointing is to copy the current state of the in-memory database to the .kdb as the database snapshot. Now, if a shutdown occurs, we only have to replay the transactions since the last snapshot, which should allow us to restart Appian much more quickly. 
 All this to say, it shouldn't be necessary to perform a checkpoint as a step in an Appian process because the engine data is always stored both in memory and on disk. In fact, Appian will automatically checkpoint if the expected time to replay all the transactions since the last successful checkpoint exceeds a given threshold.

Peter Lewis · Answer

In this case a transaction refers to any time we update data, so it most cases it's even more granular than execution of a node. For instance, if I start a node, the node now becomes active (so its status has changed), so that would be committed as a transaction. However, if a node is reassigned to someone else, that would also update information and would require a transaction. 
 The best way to think about it is if you are able to see the information in the process monitoring view, then that information has already been committed!

Process instances and checkpoints

Top Replies