Web API Limitations

judym598

Certified Senior Developer

over 8 years ago

What's the best way to 'GET' a large amount of data via Web API? I initially created Web APIs that used the a!queryEntity function to pull incremental changes from several tables, but have been asked to revise them to pull all records from these tables. There are several tables that have ~ 1000 records, which is not a problem (yet), but others are quite large. In the testing I've done so far on one table, I am able to retrieve 15,000 records but any more returns an error. Is there a way to include a looping function in the API to retrieve multiple extracts if the number of records exceeds a certain count?

Discussion posts and replies are publicly visible

Parents

0 judym598
Certified Senior Developer
over 8 years ago

Thank you for the suggestion @chetany! I don't think the view option will work but maybe the other one will. I'm not sure how to let the caller of the web api pass a startIndex and batchSize but I'm guessing it would be similar to allowing them to provide a date range. The one problem with this is that we're going to try and set this up as a system call - not a user call (i.e., automatic retrieval of data).
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel

Reply

0 judym598
Certified Senior Developer
over 8 years ago

Thank you for the suggestion @chetany! I don't think the view option will work but maybe the other one will. I'm not sure how to let the caller of the web api pass a startIndex and batchSize but I'm guessing it would be similar to allowing them to provide a date range. The one problem with this is that we're going to try and set this up as a system call - not a user call (i.e., automatic retrieval of data).
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel

Children

No Data