Question

Issue while querying large data - data approx 1M+

Forum|Forum|3 years ago
May 13, 2023
10 replies
0 views

Hi Team,

I was facing some issue while querying and performing larger data such as approx 1M+ data at a time. Considered I'm querying data from approx 5 table using some filter to reduce some search results and storing in seperate variable with the help of index() function. Even I'm having more data and I'm performing approximate n time (rare case n^2 times) as looping so Appian expression rule was failing shows as one pop up with please try later in the code such approx 502, 504. Is there any limit in Appian hold particular level of data or no such limit? Anyone has any idea is there any better way to handle this larger case of data...

Thanks and Regards,

Vigneshkumar Radhakrishnan

mathieud0001

Brainy

You are bound by memory. Appian has a circuit breaker to avoid you bringing it down.

I would suggest filtering directly in your query. Don't use index or forEach on such large datasets.

vigneshkumarr0001Author

Even after multiple filters, there was more data so not able to access at the same time. Can you share bit more about Appian circuit breaker?

mathieud0001

Brainy

What are you using this query for?

Are you displaying a grid? In that case, you should use paging.

R

ravis5657

Hi [mention:baeaa925030c41b0b61cfa423aa8556a:e9ed411860ed4f2ba0265705b8793d05],

You may create a stored procedure and create an expression rule to fetch that data using executeStoredProcedure function.
Thank You.

R

ravis5657

And may you please provide some more details that how you are using that data?
I mean, in a grid, and so on?

vigneshkumarr0001Author

Hi Ravi, Im trying to use large amount of Number(Integer) from table and trying to access in process model. Can you please share more about stored procedure and executeStoredProcedure function?

Sign up

Login with SSO

Login to the community

Login with SSO