Querying Millions of Records

Hi Experts,

Need suggestions on below question:

1: How to export data from DB to Excel if no of records are in million

2: Which type of record to used if data is in million and how.( Entity baked/Expression Baked and how to keep them memory Efficient)

3: How to optimize Views

Thanks,

Gaurav Singh

  Discussion posts and replies are publicly visible

  • 0
    Certified Lead Developer

    The Export Data Store Entity to Excel smart service automatically handles paging to allow for very large data sets to be exported without hitting query memory limits.  However with millions of records, I'm unclear as to whether an Excel file will even work when you attempt to open it.

  • Hi Mike,

    Thanks for your response. Slight smile

    With Export DSE to Excel I have tried to generate excel it took sometime but successfully given the file with 1.47lakhs rows which i was able to open it.

    Just wanted to know will there be any other way to make it quick during export. Like what if we use Export SQL to Excel then what.

    In my previous project Export DSE to Excel was being used but it used to take around 10-11mins to give the output file where data were in lakhs.

    Suggest if there is any other efficient way to handle this.

    Also your thoughts on other point are highly appreciated.

    Thanks,

    Gaurav Singh