we're currently doing a survey app that will input an excel file ->parse

we're currently doing a survey app that will input an excel file ->parse data using excel to cdt plugin, store data into 2 datastores and subprocess for the reporting. Here's the scenario/issues we're encountering:
1. Each file contains 1000+ rows and when we try to upload the file the ff error occured: "The number of tasks per node for "Current data" would exceed the limit of 1000." -.does it mean that we can't upload as many info more than 1000?
2. We then try to upload another excel file with 600+ rows only,yes it will upload but will take more than 30 mins (for the add new feature) but when we updated those 600+ info using the same concept, it would take us for about an hour. If this the case, how can we make it faster. This won't work with our requirement.Any suggestions?

TIA....

OriginalPostID-63749

OriginalPostID-63749

  Discussion posts and replies are publicly visible

Parents
  • thanks for the info, yes i'm currently using a subprocess for the reporting,i need this because we need to provide graphical representation of data in different views,and we can't do this by just displaying data in paging grid..i tried to redesign my process and i was able to reduce 1hr+ into 30mins,for 1000+rows of data in the excel sheet by dividing the file into 2,and making 500rows/file per upload. Does this usually take this long?We need to upload about 181 excel sheet with 240,000 rows of data.what's the best way to handle this?
Reply
  • thanks for the info, yes i'm currently using a subprocess for the reporting,i need this because we need to provide graphical representation of data in different views,and we can't do this by just displaying data in paging grid..i tried to redesign my process and i was able to reduce 1hr+ into 30mins,for 1000+rows of data in the excel sheet by dividing the file into 2,and making 500rows/file per upload. Does this usually take this long?We need to upload about 181 excel sheet with 240,000 rows of data.what's the best way to handle this?
Children
No Data