Returning large data from query in small batch

Create a query entity rule like
a!queryEntity(
entity: cons!TEST_ENTITY,
query:
a!query(
filters:
{
Filters you want to add
},
pagingInfo:ri!!pagingInfo
)
)

Create a new rule in which we will iterate the loop according to the total count of the datasubset

with(
local!batchSize: 1000,
local!filters: a!fromJson(
ri!input
),
local!pagingInfo: a!pagingInfo(
startIndex: 1,
batchSize: - 1
),
local!iterations: roundup(
cast(
typeof(
1
),
local!filters.totalCount
) / local!batchSize,
0
),
local!dt: apply(
rule!TestReportViewDataOnly(
pagingInfo: _,
filters: local!filters
),
apply(
topagingInfo(
_,
local!batchSize
),
1 + enumerate(
local!iterations
) * local!batchSize
)
),
.
.
.
.
)

I hope this will help you

Create a query entity rule like
a!queryEntity(
entity: cons!TEST_ENTITY,
query:
a!query(
filters:
{
Filters you want to add
},
pagingInfo:ri!!pagingInfo
)
)

Create a new rule in which we will iterate the loop according to the total count of the datasubset

with(
local!batchSize: 1000,
local!filters: a!fromJson(
ri!input
),
local!pagingInfo: a!pagingInfo(
startIndex: 1,
batchSize: - 1
),
local!iterations: roundup(
cast(
typeof(
1
),
local!filters.totalCount
) / local!batchSize,
0
),
local!dt: apply(
rule!TestReportViewDataOnly(
pagingInfo: _,
filters: local!filters
),
apply(
topagingInfo(
_,
local!batchSize
),
1 + enumerate(
local!iterations
) * local!batchSize
)
),
.
.
.
.
)

I hope this will help you

Hi Arpit,

Thanks for sharing a rule to call the query enity recursively with variable batchsize. But the problem is that it is return as list of datasubset as output. For example

Suppose if there are 790 records and batchsize is 100, we are getting an single output as  list of 8 datasubsets. How to merge the output of 8 datasubset into 1 datasubset. Tried many functions but not able to merge the data at the end.

Actual output is

local!datasubset1 - List of 8 datasubset with batchsize of 100

Expecting an output as

local!datasubset1 - List of 1 datasubset with 790 rows

Thanks in advance for reply.

Peter Lewis said:

This post is 4+ years old

Welcome to the theme of today, apparently.