Efficient Log File Management on Appian Cloud: Seeking Best Practices

RE: Efficient Log File Management on Appian Cloud: Seeking Best Practices

Karikalan Ramakrishnan — Sun, 01 Oct 2023 09:55:01 GMT

Thanks Steve / Mathieu,

Cost optimization represents a fundamental aspect of well-architected standards in the realm of cloud applications. In pursuit of storage and cost optimization, some may prefer removing archived logs after a 30-day period. As we aware, this uploading into S3 bucket approach proves more cost-effective compared to the alternative of expanding disk storage solely to accommodate archived log files within the Appian Cloud infrastructure.

In on-premises environment, we have the flexibility to upheld a data retention policy of 12 months for logs, primarily for historical data tracking and debugging purposes. This could be nice to have feature, I'm exploring options within the Appian App Market or alternative solutions to facilitate bulk downloading of Appian Cloud log files. Your provided link is greatly appreciated, and I will further investigate this resource. Thanks again.

RE: Efficient Log File Management on Appian Cloud: Seeking Best Practices

Mathieu Drouin — Sat, 30 Sep 2023 12:53:15 GMT

If you are in the cloud, you shouldn't have to worry about disk space (aside from the cost) but you don't have much control on how those log files are managed.

If you are looking to put those logs somewhere for further analysis or ingest them in a SIEM (i.e. DataDog, Splunk etc.) - I would suggest you take a look at Log Streaming for Appian Cloud - https://docs.appian.com/suite/help/23.3/Log_Streaming_for_Appian_Cloud.html.

RE: Efficient Log File Management on Appian Cloud: Seeking Best Practices

Stefan Helzle — Sat, 30 Sep 2023 12:07:08 GMT

From my perspective, not having to care about things like this, is one of the main reasons to use the cloud. If you do not have any very specific use case or requirement, I would just leave it as it is.