https://community.appian.com/discussions/f/general/27088/need-to-handle-35-40-mb-excel-data-with-100-columnsI have a requirement where I have to process, filter and Validate 35-40 MB data in excel with 100+ columns and if validation is successful then Import the data into Landing table. What could be the best way to design this. We don&#39;t have any controlen-USTelligent Community 12https://community.appian.com/thread/106329?ContentTypeID=1Fri, 06 Jan 2023 06:53:30 GMTd3a83456-d57b-489c-a84c-4e8267bb592a:8599a7c1-e76e-44a8-aaa5-bd6d130ebcc5gauravg568<p>Hi,</p> <p>It seems likely that this is 35-40 MB data in Excel with 100+ columns is an Export taken from another system. If so, worth exploring if Appian can directly integrate with this other system so the other system can periodically &#39;push&#39; data to Appian such as by invoking an Appian WebAPI or Appian can &#39;pull&#39; data from other system assuming the other system makes avaialble an API to integrate. A&nbsp;direct integration between Appian and other system would allow programmatic control over aspects such as batch size, frequency of sync, etc. Therefore, would be preferred over using large Excel files.&nbsp;</p> <p>If this is not possible, given the amount of time involved with processing, filtering and validating 35 - 40 MB data in Excel, suggest use of Asynchronous pattern of &#39;<a href="https://docs.appian.com/suite/help/22.4/recipe-refresh-until-asynchronous-action-completes.html">Refresh Until Asynchronous Action Completes</a>&#39; to process, filter and validate the Excel file in the background, and display the results to the user once the &#39;asynchronous&#39; series of activities completes.</p><div style="clear:both;"></div>