Skip to main content
gopuh
Known Participant
Aug 10, 2023 9:48 AM UTC
Question

Read Excel In batches

Hi Everyone,

I have a requirement of uploading an excel which contains around 50k records.

Currently , we are using plugin to extract data from file to DB which is having automatic batch size. But, CPU utilization and heap memory usage is too high which is causing environment to break down sometimes.

I came across Read Excel File Paging Function , But even with this function writing to DB had much complexity of mapping and all.

Any other way that we can acheive this using other plugins or anything?

    4 replies

    mathieud0001
    mathieud0001
    Genius
    Aug 10, 2023 12:54 PM UTC

    Which Smart Service were you using for the first approach?

    gopuhAuthor
    Known Participant
    Aug 10, 2023 12:58 PM UTC

    Plugin to extract data from file to DB

    mikes0011
    mikes0011
    Brainy
    Aug 10, 2023 1:57 PM UTC
    Read Excel File Paging Function

    This is the one you need to use.  The complexity can easily be dealt with using an expression rule to fetch each page.  Paging can be managed via a looping process model.  None of the other options you've mentioned even come close to the robustness offered via readExcelSheetPaging().

    The Expression Guru
      Terms & ConditionsAccessibility statement