Skip to main content
G
gopuh
August 10, 2023
Question

Read Excel In batches

  • August 10, 2023
  • 4 replies
  • 0 views

Hi Everyone,

I have a requirement of uploading an excel which contains around 50k records.

Currently , we are using plugin to extract data from file to DB which is having automatic batch size. But, CPU utilization and heap memory usage is too high which is causing environment to break down sometimes.

I came across Read Excel File Paging Function , But even with this function writing to DB had much complexity of mapping and all.

Any other way that we can acheive this using other plugins or anything?

    4 replies

    mathieud0001
    mathieud0001
    Brainy
    August 10, 2023

    Which Smart Service were you using for the first approach?

    G
    gopuhAuthor
    August 10, 2023

    Plugin to extract data from file to DB

    mikes0011
    mikes0011
    Brainy
    August 10, 2023
    Read Excel File Paging Function

    This is the one you need to use.  The complexity can easily be dealt with using an expression rule to fetch each page.  Paging can be managed via a looping process model.  None of the other options you've mentioned even come close to the robustness offered via readExcelSheetPaging().

    The Expression Guru
      Terms & ConditionsAccessibility statement