<?xml version="1.0" encoding="UTF-8" ?>
<?xml-stylesheet type="text/xsl" href="https://community.appian.com/cfs-file/__key/system/syndication/rss.xsl" media="screen"?><rss version="2.0" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:slash="http://purl.org/rss/1.0/modules/slash/" xmlns:wfw="http://wellformedweb.org/CommentAPI/"><channel><title>Load data From S3 to Appian Tables</title><link>https://community.appian.com/discussions/f/integrations/38401/load-data-from-s3-to-appian-tables</link><description>What is the most efficient way to import a daily CSV with 1 million rows from s3 into an Appian? (On daily basis we have to truncate the table and load the new data).</description><dc:language>en-US</dc:language><generator>Telligent Community 12</generator><item><title>RE: Load data From S3 to Appian Tables</title><link>https://community.appian.com/thread/144775?ContentTypeID=1</link><pubDate>Sat, 25 Jan 2025 14:37:34 GMT</pubDate><guid isPermaLink="false">d3a83456-d57b-489c-a84c-4e8267bb592a:b55f6319-e6fd-49f2-89ad-c9eedd95f8e1</guid><dc:creator>jasmithak</dc:creator><description>&lt;p&gt;Waiting for the file, once we got it, i will try the first approach and monitor the performance trends.&lt;/p&gt;&lt;div style="clear:both;"&gt;&lt;/div&gt;</description></item><item><title>RE: Load data From S3 to Appian Tables</title><link>https://community.appian.com/thread/144774?ContentTypeID=1</link><pubDate>Sat, 25 Jan 2025 14:32:09 GMT</pubDate><guid isPermaLink="false">d3a83456-d57b-489c-a84c-4e8267bb592a:7f8c2b0f-cfa5-4999-a6f2-0b3eefdbe40f</guid><dc:creator>Mathieu Drouin</dc:creator><description>&lt;p&gt;I&amp;#39;ve never done it personally but you can try using Chat GPT to explain the different steps involved.&lt;/p&gt;
&lt;p&gt;Personally I would try the 1st method above and see if it works for before trying the Athena method.&lt;/p&gt;&lt;div style="clear:both;"&gt;&lt;/div&gt;</description></item><item><title>RE: Load data From S3 to Appian Tables</title><link>https://community.appian.com/thread/144772?ContentTypeID=1</link><pubDate>Sat, 25 Jan 2025 14:05:26 GMT</pubDate><guid isPermaLink="false">d3a83456-d57b-489c-a84c-4e8267bb592a:489037bc-cbc6-4d40-a80d-403638d3a829</guid><dc:creator>jasmithak</dc:creator><description>&lt;p&gt;&lt;span&gt;As of now we don&amp;#39;t have an option for AWS database.&lt;/span&gt;&lt;br /&gt;Thank you, I will research how can we integrate&amp;nbsp;with Athena. Never tried. keep you posted how it goes.&lt;br /&gt;ever tried to integrate with AWS Glue?&amp;nbsp;&lt;/p&gt;&lt;div style="clear:both;"&gt;&lt;/div&gt;</description></item><item><title>RE: Load data From S3 to Appian Tables</title><link>https://community.appian.com/thread/144771?ContentTypeID=1</link><pubDate>Sat, 25 Jan 2025 14:05:06 GMT</pubDate><guid isPermaLink="false">d3a83456-d57b-489c-a84c-4e8267bb592a:d24115ee-45bf-4438-b4f4-bdc9e9405083</guid><dc:creator>Mathieu Drouin</dc:creator><description>&lt;p&gt;I think it&amp;#39;ll be fine personally. Otherwise your other option is to have a service backed record with the method mentioned below.&lt;/p&gt;&lt;div style="clear:both;"&gt;&lt;/div&gt;</description></item><item><title>RE: Load data From S3 to Appian Tables</title><link>https://community.appian.com/thread/144770?ContentTypeID=1</link><pubDate>Sat, 25 Jan 2025 14:01:56 GMT</pubDate><guid isPermaLink="false">d3a83456-d57b-489c-a84c-4e8267bb592a:0356e703-2cf4-43d7-8360-6735bb5a6326</guid><dc:creator>jasmithak</dc:creator><description>&lt;p&gt;Yeah, That&amp;#39;s the option but am thinking about the performance. so looking for other options.&amp;nbsp;&lt;/p&gt;&lt;div style="clear:both;"&gt;&lt;/div&gt;</description></item><item><title>RE: Load data From S3 to Appian Tables</title><link>https://community.appian.com/thread/144769?ContentTypeID=1</link><pubDate>Sat, 25 Jan 2025 09:03:36 GMT</pubDate><guid isPermaLink="false">d3a83456-d57b-489c-a84c-4e8267bb592a:f9e99d2a-320e-4217-abcc-b835bc4c0757</guid><dc:creator>Mathieu Drouin</dc:creator><description>&lt;p&gt;You don&amp;#39;t even need to load it in a DB if you can get this setup&lt;/p&gt;
&lt;p&gt;&lt;a href="https://aws.amazon.com/blogs/aws/amazon-athena-interactive-sql-queries-for-data-in-amazon-s3/"&gt;aws.amazon.com/.../&lt;/a&gt;&lt;/p&gt;&lt;div style="clear:both;"&gt;&lt;/div&gt;</description></item><item><title>RE: Load data From S3 to Appian Tables</title><link>https://community.appian.com/thread/144768?ContentTypeID=1</link><pubDate>Sat, 25 Jan 2025 09:00:22 GMT</pubDate><guid isPermaLink="false">d3a83456-d57b-489c-a84c-4e8267bb592a:5c412597-0ef7-42ad-92d1-a1fa05c91820</guid><dc:creator>Stefan Helzle</dc:creator><description>&lt;p&gt;Would it be an option to store that data in a database at Amazon and connect that to Appian?&lt;/p&gt;&lt;div style="clear:both;"&gt;&lt;/div&gt;</description></item><item><title>RE: Load data From S3 to Appian Tables</title><link>https://community.appian.com/thread/144767?ContentTypeID=1</link><pubDate>Sat, 25 Jan 2025 08:43:11 GMT</pubDate><guid isPermaLink="false">d3a83456-d57b-489c-a84c-4e8267bb592a:c100e2bc-1b61-44e7-ac46-7e6103150b88</guid><dc:creator>Mathieu Drouin</dc:creator><description>&lt;p&gt;Create a process that runs daily that:&lt;/p&gt;
&lt;p&gt;1. Downloads the file from S3 (via Amazon S3 Utilities plugin -&amp;nbsp;&amp;nbsp;&lt;a href="https://community.appian.com/b/appmarket/posts/amazon-s3-utilities"&gt;Amazon S3 Utilities&lt;/a&gt;&amp;nbsp;)&lt;/p&gt;
&lt;p&gt;2. Imports the CSV into Database (via Excel tools plugin -&amp;nbsp;&amp;nbsp;&lt;a href="https://community.appian.com/b/appmarket/posts/excel-tools"&gt;Excel Tools&lt;/a&gt;&amp;nbsp;)&lt;/p&gt;&lt;div style="clear:both;"&gt;&lt;/div&gt;</description></item></channel></rss>