Want to add to the database in smaller chunks, Need to design process

Question

If I have 1000 records that I want to add to the database in smaller chunks, how should I design a process to accomplish this?
I have a few potential solutions, but I'm unsure about their performance implications:

Implementing a loop: In each iteration, I would send data in manageable chunks.
Utilizing an XLSX file: I could create an XLSX file and then use the Excel to Database smart service to transfer the data.
Using a stored procedure.

However, I need clarification on the most suitable approach in terms of performance before implementing this functionality.

konduruc733182 · Accepted Answer

Hello [mention:22441f4b76d54668b9ec7593ce03ccbd:e9ed411860ed4f2ba0265705b8793d05]

Doing the following would not put much impact on Performance.

1. Get the data from your excel to a staging/temporary table

2. From this temp table, create a paging and get 100 records per time in an ER and use Stored procedure and write it to the actual table.

stefanhelzle0001 · Answer

Is that a one-time job? If not, how often is that import triggered? Only once at a time, or can there be multiple at the same time?

In general, my best experience is: XLS->Temp DB table->Stored Procedure->Final table.

Try to avoid any looping inside Appian using expressions or processes.

Sign up

Login with SSO

Login to the community

Login with SSO