Creating text file with 25000-30000 rows of Data.

Question

I am creating a text file with the multiple pipe delimiter data. 
 
 H|Header1|Header2|Header3 D|Column1|Column2|Column3 D|Data1|Data2|Data3 D|Data4|Data5|Data6 D|Data7|Data8|Data9 T|Trailer1|Trailer2|Trailer3 
 In the above format "H" means Header, "D" means Data and "T" means trailer 
 I am fetching the data and using the expression rule to create the data in the above format. Then using Text Doc From template smart service to pass the Header, Data and Trailer separately in the smart service. 
 Right now, I am performing test with 200 rows it is working fine but in the UAT the data will be around 25000-30000 rows of data. I am thinking it can create the performance issue. Can anyone suggest me the best approach by which I can get the expected data format with good performance, 
 
 Thanks in advance

Mike Schmitt · Answer

Did you try just using the Text from Template smart service? If your data load is only 25 - 30 thousand rows, i suspect it might just work. You're barely even much more than a megabyte of total data at that point (depending on what the text lines actually contain at least), so the file would still be reasonably manageable at least while it's within appian.

Mike Schmitt · Answer

you should be able to do this through a simple a!forEach() loop - what have you already tried? is there anything in particular you're having a hard time figuring out?