Want to add to the database in smaller chunks, Need to design process

Question

If I have 1000 records that I want to add to the database in smaller chunks, how should I design a process to accomplish this? 
 I have a few potential solutions, but I'm unsure about their performance implications: 
 
 Implementing a loop: In each iteration, I would send data in manageable chunks. 
 Utilizing an XLSX file: I could create an XLSX file and then use the Excel to Database smart service to transfer the data. 
 Using a stored procedure. 
 
 However, I need clarification on the most suitable approach in terms of performance before implementing this functionality.

Konduru Chaitanya · Accepted Answer

Hello Ankush Sharma 
 Doing the following would not put much impact on Performance. 1. Get the data from your excel to a staging/temporary table 
 2. From this temp table, create a paging and get 100 records per time in an ER and use Stored procedure and write it to the actual table.

Stefan Helzle · Answer

Is that a one-time job? If not, how often is that import triggered? Only once at a time, or can there be multiple at the same time? 
 In general, my best experience is: XLS->Temp DB table->Stored Procedure->Final table. 
 Try to avoid any looping inside Appian using expressions or processes.

Want to add to the database in smaller chunks, Need to design process

Top Replies