We have a process where data from a third party system is imported daily into Appian based on a scheduled time of process model. Currently we are using the sync record web service to manage this data transfer.
However , we are not using any data base in Appian. we're concerned about the 4 million record limit of this web service sync record.
What happens when the record count reaches to the 4 million limit?
is there an optimal approach to manage this process in Appian to avoid reaching this limit or any best practices for managing large volume of data with Appian record sync .
Discussion posts and replies are publicly visible
HiLokesh when you are storing in Appian, give it a try by segregating your data into different classifications. keep your active cases in one record, and closed cases in another record, as you can divide data that can allow more rows of data to be stored in Appian. Also, I would suggest implementing archiving the data.
Hello Abhishek Karumuru , As I have mentioned earlier, we don't have any source filters for service backed records so that segregation is not possible and Could you please elaborate on "[ implementing archiving the data ]".
I need to show the incoming data as is and its based on each day data. Also I am not storing any data in our cloud except records.Thanks.
By when do you expect your 4 million count to be exhausted?
Appian earlier had 2,000,000 rows as sync limit in 22.4, currently it is 4 million. So, it is expected to get increased in future.
Hello Soma , Lets Assume per day I will receive 10K records, but lets just think, in future I might receive more than that per day. So in future total will be exhausted more than 4 million. Then might be a chance of backdrop of my data.I hope Appian Next Release may Increase the limit.
In that case you have to decide which 4 million row is important for you.
Appian will increase the limit in future releases.