How to get data from db in optimized way.

RE: How to get data from db in optimized way.

Stefan Helzle — Thu, 20 Jul 2023 08:41:28 GMT

I do not have an example at hand. Writing a stored procedure for MariaDB/MySQL is covered in stackoverflow.

docs.appian.com/.../Execute_Stored_Procedure_Smart_Service.html

RE: How to get data from db in optimized way.

sourabh2512 — Thu, 20 Jul 2023 08:22:51 GMT

thats what I am doing buddy,, but in order to not writing duplicate data i have to compare the appian report with the existing data in db ryt ? so while doing so first I am fetching everything from the db and then comparing and now while fetching it's causing issue due to big size.

RE: How to get data from db in optimized way.

Ignacio Morán — Thu, 20 Jul 2023 08:20:13 GMT

I would recommend according to the data you need, to create a specific table and saving/updating data directly from the process models and not trying to do it duplicating a report. Are you auditing changes? that might could be the data you need..

RE: How to get data from db in optimized way.

sourabh2512 — Thu, 20 Jul 2023 08:20:01 GMT

my ultimate goal is to write unique rows in the table.. so that can be done by using procedue as well ryt ? do you have any example for that like how to write data passed from appian using procedure.

RE: How to get data from db in optimized way.

sourabh2512 — Thu, 20 Jul 2023 08:10:27 GMT

we want to keep the data to be used for further analysis by other teams,, in appian data would not be persisted always ryt ? and we need that data so keeping it in a database.

RE: How to get data from db in optimized way.

Stefan Helzle — Thu, 20 Jul 2023 08:09:35 GMT

I understand. Does not work. You will have to find a way to NOT load ALL data and try to manipulate it in Appian memory.

Without knowing what all this data manipulation is for, an idea might be to first store that data to a temporary table and then run a stored procedure to do that merging operation.

RE: How to get data from db in optimized way.

Ignacio Morán — Thu, 20 Jul 2023 08:09:21 GMT

Why would you like to copy data from reports every day to the DB? What is the purpose?

RE: How to get data from db in optimized way.

sourabh2512 — Thu, 20 Jul 2023 08:06:22 GMT

HI,

Use case is I want to store the appian process metrics and task metrics data from the Appian report to Oracle DB.

Now in order to achieve that I am running my process everynight and what it does is it first fetch all the process metrics data from table and then from Appian process metrics report and after that it finds the unique enteries and then write to database.. this is the use case..
and pfb the ss for the erroR:

RE: How to get data from db in optimized way.

sourabh2512 — Thu, 20 Jul 2023 07:46:06 GMT

so there is a table which my appian process is updating from the appian reports.
Now in order to update it, it's first fetching everything from the table and then fetching data from the appian report and after comparing and finding the unique values it's writing those rows into the table. this is what I want to achieve.

RE: How to get data from db in optimized way.

Stefan Helzle — Thu, 20 Jul 2023 06:44:28 GMT

You can, and should not, try to load "all" rows. Please help us to understand what you want to achieve.

RE: How to get data from db in optimized way.

Ignacio Morán — Thu, 20 Jul 2023 05:59:56 GMT

Hi!

Please could you add more information regarding the use case?

Could you add a screenshot of the error you get while fetching?

Could you also explain why do you need to fetch everything at the same time?

Are you using records?

Thanks