Importing LARGE CSV and Tab Delimited files

Topics: User Forum
May 19, 2010 at 5:33 PM

Currently fgetcsv is having some problems on some of my files so I'd like to possibly use PHPExcel to import CSV

and tab delimited files into a database.

Most files are around 2MB-6MB in size; they are inventory files from customers.

I've done some tests and have run into some problems, mainly because of memory.

I have only 5 columns but sometimes up to 18000+ rows, meaning 90,000+ cells.

Is this going to be a real issue or is there anything that I can do, configuration-wise to alleviate these problems?

Coordinator
May 19, 2010 at 10:31 PM

What is your PHP memory limit, and are you using any of the cell caching methods?

May 20, 2010 at 3:45 AM
MarkBaker wrote:

What is your PHP memory limit, and are you using any of the cell caching methods?

Cell caching methods?

I am not sure what my PHP memory limits are.

 

Coordinator
May 26, 2010 at 9:28 AM

You can check your PHP memory limit by checking in php.ini or doing a phpinfo() and looking for the value of the memory_limit setting

The cell caching methods are described in section 4.2.1 of the PHPExcel Developer Documentation