Hi,
I have a dataset of 150k record that needs to be updated nightly. We get this data through an API. From the payload we will parse the data and map it to 5 individual CDT's and then write to the db.
How should I design this whole process?
Discussion posts and replies are publicly visible
I recommend using Appian's synced record type feature to accomplish this easily
https://docs.appian.com/suite/help/21.4/configure-record-data-source.html#web-service
You can set up the record type to sync every night at a specific time.