am trying to parse txt file of 7MB using readTextFromFile() but am getting Memory Circuit Breaker error
did anyone else faced this issue and can anyone please suggest the alternative to parse the txt file which has large data
Thanks in advance
Discussion posts and replies are publicly visible
Did you try running it in a process model or loading the file in a localvariable first?
Hi rajesh pamisetty
I couldn't find any documentation on the maximum supported file size.
However, in my experience, I successfully parsed a 10MB text file without issues. The problem you're facing may be related to environment configurations or slowness.
tried in local variables of rule
my file contains 6596960 chars including line breaks
Care to share your code? I've parsed files much larger than 7MB in the past.
a!localVariables( local!data:readtextfromfile( txtFile:cons!ARM_PVR_DAT_SOURCE, preserveLineBreaks:false ), local!data)
It worked with a file containing 11,036,042 characters, so your file size (6,596,960 characters) should be fine as well. The issue you're facing might be related to something else, such as environment configurations, performance limitations, or a special character that might not be supported.
we are using | as delimiter to parse the file will that be a problem?
I just tested with a 14MB file with no issues. Perhaps it would be environment related? How much memory do you have on that server?
Sorry Mathieu, am not sure how check memory in the server