Huge data fetch - "Memory threshold" problem

saratt over 7 years ago

Hi All,

I have a requirement in which there is a table of 30 columns and 1 million records.
Requirement is to fetch those records and write the data into an excel document.

1. I have created an xsd/cdt which got verfied and mapped with the table in DB
2. When i am trying to query the data with a query rule, the rule is fetching data only if the records number is <= 1400

If i try to fetch 1500 records, error occurs on the script node in which i am fetching and it sends me following error in the alert

There is a problem with task “Script Task” in the process “XXX Test”. ERROR:An error occurred while evaluating expression: CCC_CDTs:rule!YYY(pv!cid) (Expression evaluation error in rule 'YYY' at function 'queryAAA': Error evaluating function 'queryAAA' :

Memory threshold reached during output conversion

(rule: [YYY], type: [CCCDT28858], threshold: [1,048,576 bytes], objects successfully conver...

Discussion posts and replies are publicly visible

Top Replies

sparshs over 7 years ago +1

You can fetch this using a simple appian custom plugin using spring jdbc or even simple jdbc. You cannot handle this requirement using appian provided query tools i.e query entity , query rules because…

Parents

0 sparshs over 7 years ago

You can fetch this using a simple appian custom plugin using spring jdbc or even simple jdbc. You cannot handle this requirement using appian provided query tools i.e query entity , query rules because time for execution a appian databse operation is around 8 sec , you can change that setting in your custom.properties but that may have performance impacts on your environment. So i think you should create a simple appian plugin using java.
Cancel
Vote Up +1 Vote Down

Sign in to reply

Verify Answer

Cancel

Reply

0 sparshs over 7 years ago

You can fetch this using a simple appian custom plugin using spring jdbc or even simple jdbc. You cannot handle this requirement using appian provided query tools i.e query entity , query rules because time for execution a appian databse operation is around 8 sec , you can change that setting in your custom.properties but that may have performance impacts on your environment. So i think you should create a simple appian plugin using java.
Cancel
Vote Up +1 Vote Down

Sign in to reply

Verify Answer

Cancel

Children

No Data