Use case for extracting 40+ MB data from one schema to Appian Business DB

Question

I have a following Use case- 
 
 1- Need to extract 40+ MB data from different system as per Ondemand request from Appian Interface 
 2- Dump this data into some staging table residing in Appian Business Database schema and perform operation afterwards 
 
 Which solution will be most usefule in terms of Scalability and availability 
 1- Use SQLtoExcel plugin? will this support to get the dump into excel via User on demand request 
 2- Export Datastore entity to Excel? will it support 40+ MB data or will it be timed out? 
 
 Any other approach we can adopt? 
 
 Here major concern is On Demand request for processing the data via Appian Interface.

Mathieu Drouin · Answer

Not sure why you need to export to excel? The user will augment the data before re-importing it back in? 
 I'd say that Export Data Store Entity to Excel Smart Service is your best bet. It's supposed to handle large datasets. But you won't be able to do it synchronously. 
 https://docs.appian.com/suite/help/24.4/Export_To_Excel_Smart_Service.html

Stefan Helzle · Answer

This is not something I would want to implement directly in Appian. Triggering and monitoring the process from Appian is fine. And adding any Excel to the game does not improve that. I suggest to use an external ETL toolchain.