Hello Everyone,
I have requirement to save the contents from an Text file to Appian cloud Database.
Option 1) There is a plugin readtextfromfile() where I'm able to read the data and convert it into table structure.
But The file will contain 10000(15 columns) records of data is it best practice or better performance read everything at once and dump to database or
Option 2) By using the plugin function readlinesfromtextfile() . reading the rows in batches ?
Which one is better to do Or any other way to dump the data from text file to database
Thanks,
Bhargavi P.
Discussion posts and replies are publicly visible
Just a note - if you choose Option 2 then make sure that in readlinesfromtextfile() function you don't pass the numberOfLines parameter as -1 to read the whole file at once, so that down the line you preclude running into memory usage related issues.
yeah I will be doing batch processing of fetching 1000 records at a time.