Very Slow Product Import

[ijoin]

Hi,

 

I tried importing product to Prestashop, after 20 minutes and timeout occured, only 10 products imported

 

i can send the CSV via PM if needed

 

Thanks

Edited January 20, 2015 by ijoin (see edit history)

[bellini13]

Does the CSV include product images?

[ijoin]

Does the CSV include product images?

Yes,

I uploaded the image first to my server then I copied the url to the csv

10 products take about 30 minutes

[bellini13]

When you include images, prestashop has to download the images (even though they are on your server), and then is has to produce thumbnails, which can be very resource intensive.

 

try to remove the images from the CSV and see if things speed up

[dogiecutiepie]

I have the same problem while importing categories csv, extremely slow, and eventually timed out. I'm using 1.6.0.9. No image in the csv, 3-level subcategories, none of of subcategories on the 3rd level gets imported either

Edited February 20, 2015 by dogiecutiepie (see edit history)

[ijoin]

Here are some steps I've taken with no result :

 

1. Disabling index searching

2. Using relative path

3. Check all the values

 

Still, it's so slow to import even 1 product 

[ijoin]

I've tested to import products again

It takes about 20 min to import 5 products

 

Tried on 3 different server and the results are same

 

Anyone want to help? I can provide my CSV

[ijoin]

Tried again and this time it's 10 products in 1 hour

Seriously frustating..

[kslam]

I'm also facing the same thing. I have tweaked my php.ini timeouts and max execution time to a much larger number already, so that it will just run.

 

I wish Prestashop could just point to a URL and not import the images. Some of us may want to use a CDN in future for hosting images.

[bellini13]

I wish Prestashop could just point to a URL and not import the images. Some of us may want to use a CDN in future for hosting images.

 

Can you explain what this means?  You don't have to import images, and you can use a CDN for static files (js, images, css etc...)

[kslam]

When I do a CSV product import, I would like to just put in the URL to my images that will CONTINUE to sit on an external server, rather than get imported into Prestashop, via the lengthy process.

[bellini13]

Prestashop is not designed to point to an external server location for images.  the images must be stored locally, and then you can use the media server feature for CDN purposes.

Edited July 29, 2015 by bellini13 (see edit history)

[kslam]

That's exactly my point, bellini13. I'm hoping a solution can be implemented to allow for Prestashop to scale to a more enterprise level, and this involves some enhancements in the future.

 

The CSV import takes forever, and this could also be fixed if Prestashop simply allowed users to have more control over image processing on their end, assuming they are professional enough to generate all the necessary images on their own.

[bellini13]

remove the image urls from your CSV file and it will speed things up.  Then you can design and implement your own customization to do what you want with your images. 

 

if you would like to see PS enhanced, then submit your feature request using their forge. 

[RogueWaveLimited]

There is a low cost solution ($100) out there - It is "ImportFast". The import actually delays the import of the images until the first user hits the product page. A very smart solution. The import of a thousands  of products is very fast. I don't have anything to do with the company but have bought it for a couple of clients within the past year. I highly recommend the product.

[celulagrafica]

I know this topic is over a year old, but I got here searching this on Google. Did anyone noticed when working local, the Disk Usage (not RAM, not CPU) goes to 100% while you import products? And I imported just a 2 column CSV, ID and TAX. I have 2 HDDs, a SSD for my windows install and a 7,200rpm disk for saving my projects, moved my XAMPP install to the SSD and importing process speeded up a little. Worth try if you also have a faster HDD.

[bellini13]

sounds to me like you have windows pagefile active, and allowing windows to use disk for memory.

[Jignesh.aakoliya]

When you import product using csv file, don’t include image url in it.

By adding image url in csv your PrestaShop downloads that image and make thumbnails and process that images that can take time.

 

So when you import using csv simply remove image url that can save your time.

 

Thanks

Jigneshkumar

[bellini13]

While I agree with the above, a better approach is to disable the thumbnail generation during import.  Keep the image URL during the import, that usually works fine, but perform the thumbnail generation after all the products have been imported.

[Gipielle]

The import is slow also without images 

[bellini13]

provide better details.  How many records are you processing?  What information are you including in your import.  Do a sample of 10 or 100 products in the import and time how long it takes for them to complete.