Any workaround for MNI limit of 1000? Need to process 10,000+ records from

Jess over 9 years ago

Any workaround for MNI limit of 1000?
Need to process 10,000+ records from CSV file and save it to database,but beforehand,it needs to process complex task ex. Generate/plot planned completion date based on milestones (7) and received date.. I don't think looping functions can be used here since there are lots of Database and Query rule interaction as part of the process. The records from CSV will be saved as the parent record and the generated data from each record as the child (1:M). Please advise. TIA.

Discussion posts and replies are publicly visible

Parents

0 PhilB
A Score Level 1
over 9 years ago

You could also batch the processing in batches of 500, and run an MNI for each set of 500 results. Have a look at configuring the end node in a process to start an instance of itself - this is often useful when batching large amounts of data as the process can call itself until the processing is done, and then tell the parent process that it has completed by flowing to a different end (or terminate) node.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel

Reply

0 PhilB
A Score Level 1
over 9 years ago

You could also batch the processing in batches of 500, and run an MNI for each set of 500 results. Have a look at configuring the end node in a process to start an instance of itself - this is often useful when batching large amounts of data as the process can call itself until the processing is done, and then tell the parent process that it has completed by flowing to a different end (or terminate) node.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel

Children

No Data