Appian Community
Site
Search
Sign In/Register
Site
Search
User
DISCUSS
LEARN
SUCCESS
SUPPORT
Documentation
AppMarket
More
Cancel
I'm looking for ...
State
Not Answered
+1
person also asked this
people also asked this
Replies
7 replies
Subscribers
7 subscribers
Views
3801 views
Users
0 members are here
Share
More
Cancel
Related Discussions
Home
»
Discussions
»
General
Huge data fetch - "Memory threshold" problem
saratt
over 7 years ago
Hi All,
I have a requirement in which there is a table of 30 columns and 1 million records.
Requirement is to fetch those records and write the data into an excel document.
1. I have created an xsd/cdt which got verfied and mapped with the table in DB
2. When i am trying to query the data with a query rule, the rule is fetching data only if the records number is <= 1400
If i try to fetch 1500 records, error occurs on the script node in which i am fetching and it sends me following error in the alert
There is a problem with task “Script Task” in the process “XXX Test”. ERROR:An error occurred while evaluating expression: CCC_CDTs:rule!YYY(pv!cid) (Expression evaluation error in rule 'YYY' at function 'queryAAA': Error evaluating function 'queryAAA' :
Memory threshold reached during output conversion
(rule: [YYY], type: [CCCDT28858], threshold: [1,048,576 bytes], objects successfully conver...
OriginalPostID-252548
Discussion posts and replies are publicly visible
Top Replies
sparshs
over 7 years ago
+1
You can fetch this using a simple appian custom plugin using spring jdbc or even simple jdbc. You cannot handle this requirement using appian provided query tools i.e query entity , query rules because…
Parents
0
Colton Beck
over 7 years ago
I'd highly recommend not creating an Excel document that contains one million rows.
One solution for your querying problem is to batch the query and run it multiple times. E.g. return 1000 rows, update document, return the next 1000 rows, update document, etc.
Cancel
Vote Up
0
Vote Down
Sign in to reply
Verify Answer
Cancel
Reply
0
Colton Beck
over 7 years ago
I'd highly recommend not creating an Excel document that contains one million rows.
One solution for your querying problem is to batch the query and run it multiple times. E.g. return 1000 rows, update document, return the next 1000 rows, update document, etc.
Cancel
Vote Up
0
Vote Down
Sign in to reply
Verify Answer
Cancel
Children
No Data