How to get the data which are not successfully inserted in database?

RE: How to get the data which are not successfully inserted in database?

deepanshua — Thu, 16 Aug 2018 06:48:00 GMT

Hi Sudipta Biswas,

The possible way of finding out the data which was not inserted successfully after calling writetodatabaseentity() would be by comparing what you were trying to write earlier and what came out in fv!storedValues. Hope this helps.

Regards,
Deepanshu Agrawal

RE: How to get the data which are not successfully inserted in database?

Sunil Zacharia — Thu, 16 Aug 2018 06:40:12 GMT

Hi Sudiptab,

I don’t think you can use the onError for this use case. What I would suggest is to identify the potential reasons why a dB update/insert would fail for the scenario that you’re working on and the. build an expression that will validate your CDT array for potential errors before calling the write to datastore smart service. This way you will know what rows will fail before an unnecessary DB call.

Regards,

Sunil Zacharia

RE: How to get the data which are not successfully inserted in database?

Sudipta Biswas — Thu, 16 Aug 2018 05:58:10 GMT

How can I use onError? Could you please explain briefly ?

RE: How to get the data which are not successfully inserted in database?

Sudipta Biswas — Thu, 16 Aug 2018 05:57:23 GMT

I am not getting partial commit issue, as sunilz said its about single transaction. Either all the fields of the records are getting written or the total row is failing to get written. I want to get the records which are failing.

RE: How to get the data which are not successfully inserted in database?

aloks0189 — Thu, 16 Aug 2018 02:05:19 GMT

Yes, in fact that's what my understanding is. But also i am curious about the Auto Commit feature of DB.

As per my understanding, this Smart Service/function should be setting the autocommit to false upon startup and upon successful operation they would be committing the transaction. And hence we should not expect partial commit here.

Happy to be corrected by the practitioner, if i am wrong!

Hence, curious to know, Sudipta Biswas are your facing this partial commit issue?

RE: How to get the data which are not successfully inserted in database?

Sunil Zacharia — Wed, 15 Aug 2018 20:49:02 GMT

Hi,

My understanding is that the write to datastore entity is executed as a single transaction, therefore if insert fails for even a single row then the entire transaction is rollled back which means there is no scenario of a partial commit.

Isn’t that how it works? Or I’m I missing something?

RE: How to get the data which are not successfully inserted in database?

aloks0189 — Wed, 15 Aug 2018 03:46:11 GMT

HI Sudipta Biswas

Do you want to say, when you are persisting an array of CDT to the database using smart service function, only few rows are being inserted and rest all are getting fail? Are you facing this issue? If so, did you try inspecting the error root cause?

And if so, then following points you should consider here:

1. Here difference will not able able to help you, because before persisting the data, your Primary Key values will be null but after persisting, each successfully persisted row will hold their Primary Key Value, means it's not the same, and every single row will be treated as different (irrespective of whether that row was successfully persisted or not).

2. You need to manually check the error root cause (e.g. some fields are marked as Not Null but you are trying to push null values for those fields in few of the indexes of this CDT || your content exceeding the max number of character limit etc..) and then you need to perform some sort of validation for making sure that the content is not exceeding the max character count. Also either alter the column to nullable else make sure, a column shouldn't hold Empty values and other additional checks (if any).

As per my understanding, this is something you need to take care before persisting the data into the database. So that we can avoid the partial failure.

Hope this will help you in analysing & debugging this issue.

RE: How to get the data which are not successfully inserted in database?

yeswanththiyarir — Tue, 14 Aug 2018 13:55:44 GMT

Yes I think 'onError' can help you.

RE: How to get the data which are not successfully inserted in database?

saikirank319 — Tue, 14 Aug 2018 13:05:20 GMT

You can try using "onError" input or fv!storedValues to find out whether the value is getting stored in the database and accordingly get the values that are not getting stored in the db.

RE: How to get the data which are not successfully inserted in database?

Navajith K — Tue, 14 Aug 2018 12:34:04 GMT

Do you mean to say that the data is partially written to database? I believe this function should either be success or error. if you are sure that the data is partially written, then get the fv!storedvalues in a new variable onSuccess and take the difference of the variable which you used to write to DB and the variable in which the fv!storedValues is stored. Hope this helps.