Any workaround for MNI limit of 1000? Need to process 10,000+ records from

Any workaround for MNI limit of 1000?
Need to process 10,000+ records from CSV file and save it to database,but beforehand,it needs to process complex task ex. Generate/plot planned completion date based on milestones (7) and received date.. I don't think looping functions can be used here since there are lots of Database and Query rule interaction as part of the process. The records from CSV will be saved as the parent record and the generated data from each record as the child (1:M). Please advise. TIA.

OriginalPostID-144874

OriginalPostID-144874

  Discussion posts and replies are publicly visible

Parents
  • If you don't need all rows for your calcs, after pulling into a cdt (via the shared component), utilize a counter pv and loop through the cdt by index (using counter for index nbr). Just make sure to utilize sub process and delete previously completed nodes.
    Don't chain through. Delete the instances within a day.
    My concern is that the cdt will consume memory due to size so you will really need to perform performance testing.
Reply
  • If you don't need all rows for your calcs, after pulling into a cdt (via the shared component), utilize a counter pv and loop through the cdt by index (using counter for index nbr). Just make sure to utilize sub process and delete previously completed nodes.
    Don't chain through. Delete the instances within a day.
    My concern is that the cdt will consume memory due to size so you will really need to perform performance testing.
Children
No Data