Issue while querying large data - data approx 1M+

RE: Issue while querying large data - data approx 1M+

ravis — Sun, 14 May 2023 11:02:43 GMT

And talking about stored procedure, so in stored process you can join the tables and pass parameters for filtering and all.
And call that stored procedure in Process model also with smart service or function.
Thank you.

RE: Issue while querying large data - data approx 1M+

ravis — Sun, 14 May 2023 10:57:54 GMT

May you please provide some more details that how you are using that data in the process model and why you need whole data at once?
And also you may try again that query by apply selection on it (only keep those fields/columns that you need in the process).
Thank You.

RE: Issue while querying large data - data approx 1M+

vigneshkumarradhakrishnan — Sun, 14 May 2023 10:49:49 GMT

Hi Ravi, Im trying to use large amount of Number(Integer) from table and trying to access in process model. Can you please share more about stored procedure and executeStoredProcedure function?

RE: Issue while querying large data - data approx 1M+

Mathieu Drouin — Sun, 14 May 2023 10:45:10 GMT

You shouldn't be querying large sets in a process model. Why are you doing this?

RE: Issue while querying large data - data approx 1M+

vigneshkumarradhakrishnan — Sun, 14 May 2023 10:44:08 GMT

not in grid, Im querying data for trying to use in process models

RE: Issue while querying large data - data approx 1M+

Mathieu Drouin — Sun, 14 May 2023 10:33:14 GMT

What are you using this query for?

Are you displaying a grid? In that case, you should use paging.

RE: Issue while querying large data - data approx 1M+

ravis — Sun, 14 May 2023 10:30:37 GMT

And may you please provide some more details that how you are using that data?
I mean, in a grid, and so on?

RE: Issue while querying large data - data approx 1M+

ravis — Sun, 14 May 2023 10:28:47 GMT

Hi ,

You may create a stored procedure and create an expression rule to fetch that data using executeStoredProcedure function.
Thank You.

RE: Issue while querying large data - data approx 1M+

vigneshkumarradhakrishnan — Sun, 14 May 2023 09:13:15 GMT

Even after multiple filters, there was more data so not able to access at the same time. Can you share bit more about Appian circuit breaker?

RE: Issue while querying large data - data approx 1M+

Mathieu Drouin — Sat, 13 May 2023 18:00:04 GMT

You are bound by memory. Appian has a circuit breaker to avoid you bringing it down.

I would suggest filtering directly in your query. Don't use index or forEach on such large datasets.