<?xml version="1.0" encoding="UTF-8" ?>
<?xml-stylesheet type="text/xsl" href="https://community.appian.com/cfs-file/__key/system/syndication/rss.xsl" media="screen"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:slash="http://purl.org/rss/1.0/modules/slash/" xmlns:wfw="http://wellformedweb.org/CommentAPI/"><channel><title>WebAPI hitting payload limit</title><link>https://community.appian.com/discussions/f/integrations/14948/webapi-hitting-payload-limit</link><description>Hi, 
 I have a WebAPI retrieving data from the Appian Database, which is hitting the 1GB payload limit. This means I need to retrieve my data in chunks (multiple calls). 
 local!entities: a!queryEntity( entity: cons!ABD_INITIATIVE_ENTITY_CONS, query:</description><dc:language>en-US</dc:language><generator>Telligent Community 12</generator><item><title>RE: WebAPI hitting payload limit</title><link>https://community.appian.com/thread/66884?ContentTypeID=1</link><pubDate>Wed, 29 May 2019 12:40:23 GMT</pubDate><guid isPermaLink="false">d3a83456-d57b-489c-a84c-4e8267bb592a:a47ed784-2eb7-4513-9b85-1a029c128b3a</guid><dc:creator>Bibhuti Mohapatra</dc:creator><description>&lt;p&gt;Hello Oliverc,&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;I doubt that your code is eliminating the duplicate entries. This happens when we use batchSize in paging info. Suppose my table is having 10 records having 2 records duplicate then&amp;nbsp;&amp;nbsp;batchSize:5 will return total 9 records only. If you provide batchSize:-1 then you will receive complete 10 records. Hence I feel like which ever records you are currently getting having unique values, considering if you don&amp;#39;t need to have all the records to be fetched (including duplicate). If you want all the records then you might need to write a stored proc and control the data retrieval.&lt;/p&gt;
&lt;p&gt;Hope this information helps you. If it helps then hit like.&lt;/p&gt;
&lt;p&gt;Thank You.&lt;/p&gt;&lt;div style="clear:both;"&gt;&lt;/div&gt;</description></item><item><title>RE: WebAPI hitting payload limit</title><link>https://community.appian.com/thread/66880?ContentTypeID=1</link><pubDate>Wed, 29 May 2019 10:16:11 GMT</pubDate><guid isPermaLink="false">d3a83456-d57b-489c-a84c-4e8267bb592a:4f54feed-1f01-47f5-8429-0816a044f7fe</guid><dc:creator>chandu</dc:creator><description>&lt;p&gt;Hi Oliverc,&lt;/p&gt;
&lt;p&gt;Try to pass the pagination in Request params, So that you can get the data in Chunks instead off all.&amp;nbsp;&lt;/p&gt;
&lt;p&gt;But if the request calls are not immediate any data insertion is done in between there is a chance of getting the same data in between two requests.&lt;/p&gt;&lt;div style="clear:both;"&gt;&lt;/div&gt;</description></item></channel></rss>