Service Backed Full Sync Issue

Certified Associate Developer

We want to retrieve data from a another system using a service backed record approach. While doing this we saw a 5MB size data limit restriction for the full sync. Also we are not able to provide any batchNumber so as to get full data(as we are not getting this parameter to be passed to the actual API).

  1. Is there a way to get all data as part of full sync?
  2. In this service backed record sync approach, does this data gets stored to the DB? If not, where does this data reside/stored for any activity?(like insert the retrieved data to the DB)

  Discussion posts and replies are publicly visible

Parents
  • Can you give more context on what the data looks like that you're trying to sync? How many rows / columns of data do you have? How long does the web service call take to retrieve your data? Also where are you seeing a limit reached - is it when performing the API call or attempting to sync your record type?

    One approach I have seen before is to do batching or parsing the data after receiving the result and just writing a subset of the data at a time. However, this typically works only in limited circumstances where the data is larger than the limits but not significantly larger, so we'd need more context on what your data looks like and how you plan to use this.

Reply
  • Can you give more context on what the data looks like that you're trying to sync? How many rows / columns of data do you have? How long does the web service call take to retrieve your data? Also where are you seeing a limit reached - is it when performing the API call or attempting to sync your record type?

    One approach I have seen before is to do batching or parsing the data after receiving the result and just writing a subset of the data at a time. However, this typically works only in limited circumstances where the data is larger than the limits but not significantly larger, so we'd need more context on what your data looks like and how you plan to use this.

Children
No Data