I have a lot of data in which is to be written to Database. It can be like an ar

I have a lot of data in which is to be written to Database. It can be like an array of 24,000 CDT variables. I want to write it to DB. Now, I have two approaches for this. I can A) Either Write to Database in batches - I can decide a batchSize of 200 and write 200 rows at a time sequentially. This approach will take some time to completely write to DB B) I can use MNI in process models. I will still use batchSize, but now more than one Write to DS smart service will execute simultaneously. This will increase the parallel writes to DB and will also complete the process model quickly.

My question: Will the parallel writes to DB using MNI affect the performance? Also I think it will open too many DB connections to database, so is it a good idea?

OriginalPostID-215023

OriginalPostID-215023

  Discussion posts and replies are publicly visible

Parents
  • @chetany Hi, I would strongly recommend to refrain from parallel writes and to the best of my knowledge, this creates exhaustive connection pool issue and some others which I have elaborated in the comments made some time ago at the URLs mentioned below. I have previously made some comments on the similar posts at following URLs, not sure if you have gone through them, if not I will suggest doing so as I believe that you might find some useful information:

    https://forum.appian.com/suite/tempo/entry/e-191410
    https://forum.appian.com/suite/tempo/entry/e-171106
    /search?q=OriginalPostID-189203
Reply
  • @chetany Hi, I would strongly recommend to refrain from parallel writes and to the best of my knowledge, this creates exhaustive connection pool issue and some others which I have elaborated in the comments made some time ago at the URLs mentioned below. I have previously made some comments on the similar posts at following URLs, not sure if you have gone through them, if not I will suggest doing so as I believe that you might find some useful information:

    https://forum.appian.com/suite/tempo/entry/e-191410
    https://forum.appian.com/suite/tempo/entry/e-171106
    /search?q=OriginalPostID-189203
Children
No Data