Skip to main content
pranavk513898
April 24, 2023
Question

Need to update a table with millions of rows present.

  • April 24, 2023
  • 6 replies
  • 0 views

Hello Community,

I need to upgrade a table where there are more than 1 million rows available, I want to know can this operation be performed at Appian end, I am thinking of retrieving the data in batches of 5000, that batch needs to go through encryption/decryption function. Since this processing needs to be done at Appian end, so cant use Stored Procedures for this. Will Appian be able to handle such load ?

Any suggestions will be helpful ?

Thanks in advance.

    6 replies

    harshitb6843
    April 24, 2023

    There are a couple of factors to determine it. 

    1. Is this a one-time operation?
    2. If this is not a one-time operation and repetitive instead, then will the data increase over time?
    3. What is the size of each row?
    4. Any specific reason for doing it via Appian and not an SP on the database instead? 

    Doing it via SP will anyway be faster and more promising considering you have a huge data and you need to perform the update operation. 

    pranavk513898
    April 24, 2023

    Hello Harshit,
    Thanks for quick reply, I will try to elaborate: 

    1. Planning to create it as a utility, so it can be reused in future.
    2. Yes data will increase overtime.
    3. Probably 4-5 columns will be queried as one row.
    4. we need to apply new appian encrytion on these queried data, and need to store it back again, I am not sure whether encrypting the data can be done through Stored Procedure.

    harshitb6843
    April 24, 2023

    In that case, as Stefan said, you can do it during nonworking hours, when there are close to no people working and the least active processes. 

    stefanhelzle0001
    Brainy
    April 24, 2023

    You write "Since this processing needs to be done at Appian end". Seems like there are no options. Just make sure to do this during low-activity times and add a bit of a delay to the loop.