CSV import extremely slow on 1.5.3.1

[Pepozzo]

Hello!

 

I'm trying to update my shop by importing a CSV.

 

It has about 5400 lines, and with 1.4 i usually split this file in parts of 250-300 lines.

 

But with 1.5.3.1 version of Prestashop, the import is very very slow. And also a file with 50 lines, fails to update the shop and i receive an error 500.

 

How can i update my shop? Any suggestion to solve the problem?

 

Thanks

[Sippa]

same experience

[Dh42]

What is the maximum execution time that your server is set to? You might have to ask your host. Also ask them if you can override it with a php.ini file. Some hosts allow it others do not.

[Pepozzo]

Yeah, i know that. At the moment it is about 300seconds, and for this reason i usually split the file at 200/250/300 lines.

 

But from the prestashop update i didn't change the server, it is still the same, but csv update doesn't work as before.

 

Same files with PS 1.4 were uploaded without problem

[Dh42]

The best I can suggest is to file a bug report on it. It sounds like something is happening to slow it down. Have upgraded from other 1.5 versions, if so, did they have the same problem?

[Pepozzo]

Yes, before i was on PS 1.5.2, and then 1.5.3.0 but i didn't updated the store. Now i've received new prices and i've to update.

 

Last time i updated it was july and i was on PS 1.4. That's all

[Pepozzo]

Sorry for double post.

 

Do you suggest me to open a topic in the bug tracker right? The one on this site or on github?

[parsifal]

I had the same problem. After importing via CSV, I was faced with 100% CPU usage of the web server process (Apache, in the case of my VPS) for many, many minutes, that caused my Front Office's performance to suffer greatly.

 

It seems that after each import via CSV, even a CSV of 1 (one) product, PrestaShop proceeds to reindex the entire product catalog instead of just the products that were added. In my case, this would explain why the delay growed exponentially relative to the catalog's size: When I first started my shop, the first few imports didn't cause a noticeable delay. After the first 100 products or so, the import delays became unbearable.

 

After reading this article, I found out that there is an option in the BackOffice which can help a little: BO --> Preferences --> Search --> Indexation. After turning this off, the CSV import becomes blazing fast again! Please note that this is not a right proper solution, only a temporary remedy, since it has two big disadvantages:

 

1. You must request a manual reindex after each CSV import. At least this does not process the whole catalog, only the newly added products

 

2. You must request a manual reindex after each change you make in an existing product. It seems that making a change and clicking save removes the edited product from the index

Edited March 16, 2013 by parsifal (see edit history)

[raulkite]

Hello:

 

I have done this, but still VERY SLOW. It can take me 2 minutes for 40 products import. Any new idea?

 

Thanks

 

Raul

[Kimi]

if you import images via http upload them via ftp to prestashop, change absolute adress to relative in csv, it was like 2x faster for me then

because import uses php copy funtion

[Gipielle]

Someone have found a solution ?