Export Data Store Entity to Excel Smart Service - The total rows in Excel is less than total counts in DB View

Question

Dear exports, 
 I have used Export Data Store Entity to Excel Smart Service in process model. 
 1. Configured Data Store Entity is the DB View, there are 8000+ records in this view. 
 2. I didn't apply any filters. 
 3. When run process, there is no process error or any error in system log, process instance run successfully. 
 However, I only export out 5000+ records in excel, which is not expected, suppose should be all records in DB ( 8000+ ), what's the possible problem? how can I fix it? 
 
 PS: I have double check missed records, those are not duplicated records in the view. And I have done a POC, if change the DSE to point to any table, no this data missing issue in exported excel, but if change to views, some have data missing issue, some no, I have no idea that why those data will be missed.

Shubham Aware · Accepted Answer

I can suggest the following three options&mdash;choose the best one based on your feasibility and requirements. :- Optimize the View Definition : Complex views may slow down or truncate data during large exports. Simplify the view, Replace with a Stored Procedure or Function if logic is too complex, Ensure proper indexing or Batch Processing : Split export into smaller batches, Merge results into a single file. or Use Materialized View : Replace the view with a materialized view, Refresh before export to ensure latest data.

Megha Ramnani · Answer

Hi there, 
 There&rsquo;s no documented row limit for the Export Data Store Entity to Excel smart service, but this issue can occur due to implicit paging or view performance limitations. 
 As a workaround, you can try batching the data (e.g., export in chunks of 5000 rows) and merge the results.

Harsha Sharma · Answer

Views can be slower than table queries if not optimised well. Try batching the data and exporting using 2 dse to excel nodes in your process.

Export Data Store Entity to Excel Smart Service - The total rows in Excel is less than total counts in DB View

Top Replies