I am creating a text file with the multiple pipe delimiter data.
H|Header1|Header2|Header3D|Column1|Column2|Column3D|Data1|Data2|Data3D|Data4|Data5|Data6D|Data7|Data8|Data9T|Trailer1|Trailer2|Trailer3
In the above format "H" means Header, "D" means Data and "T" means trailer
I am fetching the data and using the expression rule to create the data in the above format. Then using Text Doc From template smart service to pass the Header, Data and Trailer separately in the smart service.
Right now, I am performing test with 200 rows it is working fine but in the UAT the data will be around 25000-30000 rows of data. I am thinking it can create the performance issue.Can anyone suggest me the best approach by which I can get the expected data format with good performance,
Thanks in advance
Discussion posts and replies are publicly visible
Did you try just using the Text from Template smart service? If your data load is only 25 - 30 thousand rows, i suspect it might just work. You're barely even much more than a megabyte of total data at that point (depending on what the text lines actually contain at least), so the file would still be reasonably manageable at least while it's within appian.
Thanks Mike Schmitt for your reply. My concern is when I am fetching the data from record, I am through expression rule making it "|" Pipe separated. for that what you suggest I need to do lopping or some other approach
you should be able to do this through a simple a!forEach() loop - what have you already tried? is there anything in particular you're having a hard time figuring out?