Import huge(~35 MB) CSV file into Database

Question

I have a file that have around 80000+ records and size is around 35MB. 
 I would like to understand the way to read the data in it but need paging to be part of the process as i want this to be inserted into DB.

Abhishek Karumuru · Answer

Hi jyotik5834 I would not recommend pushing larger data files into the database in one go. You can split those into smaller chunks and push them to the database, which would also help to run queries faster with minimal load.

Soma · Answer

Try the "Import CSV to Database" smart service in the excel tools plugin 
 community.appian.com/.../excel-tools 
 It has the reputation to work well even for bigger files

Soma · Answer

I tried uploading a CSV file with 640000 rows of data with the file size of 62 MB. I did not face any challenge using Import CSV to Database smart service.

Can you please clarify what is the difference we are having, so that we can try to solve your issue?

Import huge(~35 MB) CSV file into Database

Top Replies