Best Practice to write data from Excel to Database

RE: Best Practice to write data from Excel to Database

Appian Boy — Fri, 25 Jan 2019 07:27:15 GMT

The best approach is to use the csv smart service to directly load the data and store to the db (Smart Service: Import CSV to Database).

https://community.appian.com/w/the-appian-playbook/188/transferring-processing-large-data-sets-etl

community.appian.com/.../transferring-processing-large-data-sets-etl

RE: Best Practice to write data from Excel to Database

chandu — Fri, 25 Jan 2019 07:10:46 GMT

Hi Saik,
I would like to add a point on the top of Marcel paradies suggestions.
If you want to do it via write to data store entity
1. Try to Execute on batches.
2. Its good to write to Intermediate table first and then to Actual Table.

RE: Best Practice to write data from Excel to Database

Marcel Paradies — Thu, 24 Jan 2019 22:31:47 GMT

Is this a one-time batch import or a regular occurence?

If it is a one time batch-import, your DBA would probably be able to help you use the DB's specific tools (e.g. SSMS for MSSQL) and get that done painlessly for you.
If it's a regular occurrence, I would ideally use specialised tools and orchestrate the workflow with Appian if and when required.
If, for some reason, you want to do this batch-import in Appian, you could transform/save as the Excel as a csv, split the rows and then write to datastore the individual elements of the row mapped to the requisite CDT. While this works in principle I'm not certain this is something I would do with the amount of data you are talking about.