How to Insert 1000+ records into Write to datastore Entity at a time

Question

for example my array size is 3400 
 in the first write - 1 to 1000 2nd time write 1001 to 2000 3rd time write 2001 to 3000 4th time write 3001 to 3400 
 How we can achieve this one 
 can anyone help me out 
 TIA

Shanmathi Ponnusamy · Accepted Answer

Hi sindhup7044 
 1)If the data to write can be get from the query, you can use looping logic in process model. Have a process variable to hold startIndex and totalCount. Then query the 1000 or I would suggest 500 data then write to Database then Increment the startIndex and in Xor node check if StartIndex>TotalCount then end the process else continue incrementing do the loop. 
 There are different cases based on the filters you apply. Say if query with a filter status =A and then you updated status = B. Then in this case you need to modify loop logic. The above one is more generic. 
 2) if you have a list already from a process or form, then use startIndex and totalCount varaibles in loop as like above

Soma · Answer

I would suggest to go with stored procedure that has the logic to update or insert entries to the table.

Mathieu Drouin · Answer

Technically the Write Records Smart Service supports up to 50 000 records at a time. 
 
 https://docs.appian.com/suite/help/24.3/Write_Records_Smart_Service.html#setup-tab 
 As others mentioned, it really depends on the amount of data you have in each of those 3400 records which could ultimately impact performance. You also need to take into consideration the data retention. If you load a lot of data in PVs, you'll probably want to avoid archiving that process to save on disk space.

How to Insert 1000+ records into Write to datastore Entity at a time

Top Replies