What is the best way to extract data from APPIAN CLOUD DB to our Local DB?

Hi Folks,

We have appian Cloud environment using Cloud DB, and appian on-prem on our local DB.

For some reason, I need to extract data from Cloud DB into our local DB, make this ETL happened automated daily.

So what would be the best practice to make this happened?

Thanks!

  Discussion posts and replies are publicly visible

Parents Reply Children
  • Hi Peiran

    I still don't feel I understand the driver for this specific question. One o the behaviours of a Consultant is to not always take things at face value in order to discover the real requirements. 

    There is no 'best', there is what is 'optimal' for the constraints you have to work within.

    Conceptually you can 'push' or 'pull' to move data from one platform to another.Let's put 'Appian' as the centre of our discussion where 'push' means 'run something on Appian that pushes the data from Appian to your on-premise platform'. Thus 'pull' means have your platform call Appian and fetch the data'. You then also have options as to how to trigger the end-to-end process and exactly what it does  e.g. you can run something based upon a timer in your on-premise platform, call Appian (via a WebAPI) which then runs, gets a delta of the data and then SFTPs it to you. Or you can run the process in Appian on a timer-triggered process. Or you can trickle-feed every change that happens continuously throughout the on-line day using a Messge Queue so your platforms are decoupled. There are many many options, but it depends on what resources you have - what exists, what budget you have to make changes, what time-frames to get this done...and this is why I always challenge a requirement that isn't expressed in terms of value because one option you ALWAYS have (and is often the hardest to sell) is to do nothing! 

    But I feel I've said that enough times now, so I'll leave that with you.

  • Hi Stewart,

    We have a third-party team who is working on Appian Cloud Envionment and using Cloud DB. The data on Cloud DB getting update and refresh.

    We also have a appian on-prem envrionment running on our company server and this server is not open to the public, we need to use VPN connect it and doing the deveopment process.

    My company want to having a backup solution runs daily or hourly, can pull the data from Appian Cloud DB to our own Oracle Database. Which I need to setup a project on Appian Cloud environment, sending the Data (File) by using some service(maybe SFTP?) and using the on-prem server receive the File and import data(maybe powershell?) into our Oracle Database.

    I don't know is this is even doable or we have better options?