Getting data from external system via API

harshav over 7 years ago

Hi All,
We are actually trying to get the data from an external system into Appia,and after that we need to save the data into Appian DB,and the data which we get it is in the form of APIs .....and the data which s coming might be huge (around 10000) rows ....my question is
1.What are the ways to get the data into PM and into cdts
2. What s the best approach which I can follow
TIA:)

Discussion posts and replies are publicly visible

0 Colton Beck over 7 years ago

Is this a one-time migration or an ongoing job?
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 sanjays0006 over 7 years ago

Harsha,
Your use case is to retrieve the data from external system and save it into Appian DB?
If that is the usecase, it would be better to write an ETL job to get this done.
Having huge data would impact the performance of the server.

If your use case is different, then let us know.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 harshav over 7 years ago

its an on-going job
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 harshav over 7 years ago

@sanjays, Is there any way from which I can do it from an Appian standpoint, like using Appian components.
@coltonb, when ever user raises a request, it should get some data from an External system and save the data into Appian DB, could you please suggest.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 chetany
A Score Level 1
over 7 years ago

Please go through this link about processing huge data in Appian - forum.appian.com/.../Transferring_Processing_Large_Data_Sets_(ETL).html
As sanjays mentioned, if your usecase involves very huge amounts of data, an ETL tool like Informatica may prove to be helpful, since those tools are made specifically for dealing with very huge datasets.
If you want to do it in Appian, the link I provided has some suggestions.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel