Need to Import lakhs of data in Appian database by csv or excel.

Certified Lead Developer

Hello All,

I am having a requirement to import lakhs of rows data into the Appian database by using the smart services as we need to give the file upload functionality to the user.

Can anyone suggest the best way to achieve with the best performance.

Thanks in advance.

  Discussion posts and replies are publicly visible

Parents
  • 0
    Certified Senior Developer

    How Many columns will be there in the file?

    You can try import excel to DB smart service but have to check it's limitation for example it is fisible if the excel column count is less than 50. or You can read the excel and map the excel data with in the CDT and take the batches of the variable by using toDatasubset and then pass the subset data to a new process model which is handling the data insertion. In this case you can use start Process smart service as it will be asynchronus and it will run on the seperate engine which will help in load distribution.

Reply
  • 0
    Certified Senior Developer

    How Many columns will be there in the file?

    You can try import excel to DB smart service but have to check it's limitation for example it is fisible if the excel column count is less than 50. or You can read the excel and map the excel data with in the CDT and take the batches of the variable by using toDatasubset and then pass the subset data to a new process model which is handling the data insertion. In this case you can use start Process smart service as it will be asynchronus and it will run on the seperate engine which will help in load distribution.

Children
No Data