Skip to main content
S
sourabhs2166
July 20, 2023
Question

How to get data from db in optimized way.

  • July 20, 2023
  • 11 replies
  • 0 views

Hi All,

i am developing an application in whcih I have to fetch all the records from table. now the problem in doing so is while running the expression tule it's failing which i think is failing because  i am fetching everything at a time.

I want to fetch it in batches how can I make it in such a way that it fetch in batches but while writing, it should write it all at once. And also one thing this table will increase everyday by 5-7k rows.

And also if i fetch data in batches won't it hit db multiple times ? What should be preffered batch size ?

Please suggest me good practice to achieve the above.

11 replies

ignacio.moran
ignacio.moran
July 20, 2023

Hi!

Please could you add more information regarding the use case?

Could you add a screenshot of the error you get while fetching?

Could you also explain why do you need to fetch everything at the same time?

Are you using records?

Thanks

S
sourabhs2166Author
July 20, 2023

HI,

Use case is I want to store the appian process metrics and task metrics data from the Appian report to Oracle DB.

Now in order to achieve that I am running my process everynight and what it does is it first fetch all the process metrics data from table and then from Appian process metrics report and after that it finds the unique enteries and then write to database.. this is the use case..
and pfb the ss for the erroR:

ignacio.moran
ignacio.moran
July 20, 2023

Why would you like to copy data from reports every day to the DB? What is the purpose?  

stefanhelzle0001
stefanhelzle0001
Brainy
July 20, 2023

You can, and should not, try to load "all" rows. Please help us to understand what you want to achieve.

S
sourabhs2166Author
July 20, 2023

so there is a table which my appian process is updating from the appian reports.
Now in order to update it, it's first fetching everything from the table and then fetching data from the appian report and after comparing and finding the unique values it's writing those rows into the table. this is what I want to achieve.

stefanhelzle0001
stefanhelzle0001
Brainy
July 20, 2023

I understand. Does not work. You will have to find a way to NOT load ALL data and try to manipulate it in Appian memory.

Without knowing what all this data manipulation is for, an idea might be to first store that data to a temporary table and then run a stored procedure to do that merging operation.

Terms & ConditionsAccessibility statement