Writing large amounts of data to MariaDB Database

RE: Writing large amounts of data to MariaDB Database

mikels7956 — Thu, 03 Nov 2022 19:33:36 GMT

You are correct, I simply needed to create batches it solved my issue. The API is capable of batching.

RE: Writing large amounts of data to MariaDB Database

Stefan Helzle — Thu, 03 Nov 2022 17:36:02 GMT

That sounds like you need to set up the sync in batches. That is directly supported by Appian. Does the API support it as well?

RE: Writing large amounts of data to MariaDB Database

mikels7956 — Thu, 03 Nov 2022 17:33:00 GMT

I came to the same conclusion hence the following error

2022-11-03 15:21:59,404 [ajp-nio-0.0.0.0-8009-exec-444] ERROR com.appiancorp.rest.shared.AppianExceptionMapper - Internal Server Error on REST API invocation.
com.appiancorp.exceptions.LocalizedAppianRuntimeException$LocalizedAppianException: Expression evaluation error [evaluation ID = 14504:8b784] : The Memory Circuit Breaker prevented this evaluation from completing due to insufficient resources. Please contact your system administrator. (APNX-1-4510-000) (APNX-1-4510-000)

RE: Writing large amounts of data to MariaDB Database

Stefan Helzle — Thu, 03 Nov 2022 17:13:54 GMT

That sounds like a perfect use case for synced records?!?

RE: Writing large amounts of data to MariaDB Database

mikels7956 — Thu, 03 Nov 2022 15:44:33 GMT

It's coming from a data management platform which is consumed by Appian through a connected system. The format Appian gets it in is a map which we cast to whatever we need. We are obliged to use this data management platform as a hub for all data queries.

The use case is that we need the data as read-only but the request response time is very large so we are trying to find a way to "cache" it daily for Appian to be able to use it in dropdowns and dashboards.

I'm considering to call it as a local variable in interfaces but that creates large overhead for each interface that makes the call.

Another option is to call it in a process and create a process report which gets archived daily.

RE: Writing large amounts of data to MariaDB Database

Stefan Helzle — Thu, 03 Nov 2022 15:30:42 GMT

My first question: Where is that data coming from, and in which format?