How to update data from CSV file to data base

RE: How to update data from CSV file to data base

Justin Watts — Thu, 12 Apr 2018 15:34:30 GMT

I think was suggesting using the plugin to only perform the ETL since you noted that you are not allowed to execute queries with the Query RDBMS node. You would still use the CSV load to process your file into a table.

RE: How to update data from CSV file to data base

bhargavip — Thu, 12 Apr 2018 15:30:10 GMT

Hi , I am really not sure why you proposed execute stored procedure smart service but is I use this I would be bringing data to Appian where I don't want to bcz data will be huge. And I really don't have strong knowledge in creating stored procedures where do they accept document as input and process in db ??

RE: How to update data from CSV file to data base

josep — Wed, 11 Apr 2018 22:15:16 GMT

Hello Bhargavi,

What do you think about executing an store procedure? here is the smart service for that.

forum.appian.com/.../summary

Jose

RE: How to update data from CSV file to data base

bhargavip — Wed, 11 Apr 2018 18:32:32 GMT

Hi Thank you for the information. But in my organisation using Query RDBMS smart service is not an allowed practice, but I could insert into temp table and invoke a stored procedure where that stored procedure will update the staging table into target table and truncate the staging table.

I will propose this way.

RE: How to update data from CSV file to data base

Justin Watts — Wed, 11 Apr 2018 12:24:49 GMT

I'm not aware of a plugin that will do the updating, but typically what I do here is import the CSV to a staging table, then run a query using the Query RDBMS node to ETL/update the staging data into the target table. When it's done, truncate the staging table.

I agree that pulling into a CDT is a potential performance and memory consumption issue.