Web API Limitations

Certified Senior Developer
What's the best way to 'GET' a large amount of data via Web API? I initially created Web APIs that used the a!queryEntity function to pull incremental changes from several tables, but have been asked to revise them to pull all records from these tables. There are several tables that have ~ 1000 records, which is not a problem (yet), but others are quite large. In the testing I've done so far on one table, I am able to retrieve 15,000 records but any more returns an error. Is there a way to include a looping function in the API to retrieve multiple extracts if the number of records exceeds a certain count?

OriginalPostID-267239

  Discussion posts and replies are publicly visible

Parents
  • 0
    Certified Senior Developer
    Thank you for the suggestion @chetany! I don't think the view option will work but maybe the other one will. I'm not sure how to let the caller of the web api pass a startIndex and batchSize but I'm guessing it would be similar to allowing them to provide a date range. The one problem with this is that we're going to try and set this up as a system call - not a user call (i.e., automatic retrieval of data).
Reply
  • 0
    Certified Senior Developer
    Thank you for the suggestion @chetany! I don't think the view option will work but maybe the other one will. I'm not sure how to let the caller of the web api pass a startIndex and batchSize but I'm guessing it would be similar to allowing them to provide a date range. The one problem with this is that we're going to try and set this up as a system call - not a user call (i.e., automatic retrieval of data).
Children
No Data