Google Sitemap Generator Fails

[com-256]

Hi everyone,

 

I use Google Sitemap module. I have ~12600 products in my shop. Generator script fails when i try to generate a sitemap. This makes sense. Because there is an execution limit for http requests. And 12k products are too many for some kind of operation, i guess.

 

I create a cronjob in order to run script without any time limit. I am not using cURL for cronjob. Php script runs directly. The php script that i mentioned is an edited version of gsitemap-cron.php. So far so good but it didn't work. I got an error as below.

 

 

Maximum execution time of 30 seconds exceeded in classes/Tools.php on line 1479

 

There is no time limit, also other cronjobs are running perfectly. 

 

How can i solve this? I am open to another sitemap generation techniques.  

 

Thanks.

[Seirios]

I have 30000 products and about 1 million images with a shared hosting plan.

The sitemap works for me. Do you know your settings given by your hosting provider?

Also unceck the option for image presense on server, it will save you time and processes.

[Tanatus]

Hi,

I've activated an ssl for my site, but when I do a cron task for sitemap generation I get an error 500.

When generating the new sitemap (manually) it is created.

But the url is http but not the https.

Can you help with some ideas?

[doekia]

add &id_shop=1 while running from the cron

[doekia]

Ok you have a massive number of products and the cron seems to be yet again screwed and does not detect the max_execution_time or memory limit or both .
 
 
If i'll be u, i'll try patching gsitemap.php line 237

if ($i <= 10000 && memory_get_usage() < 100000000)

20x 10000 means 200000 link so I guess that be enough to cover your catalog
 
If it does not work, sorry, you'll have to way until someone look at it deeper

[Tanatus]

Ok you have a massive number of products and the cron seems to be yet again screwed and does not detect the max_execution_time or memory limit or both .

 

 

If i'll be u, i'll try patching gsitemap.php line 237

if ($i <= 10000 && memory_get_usage() < 100000000)

20x 10000 means 200000 link so I guess that be enough to cover your catalog

 

If it does not work, sorry, you'll have to way until someone look at it deeper

I have

if ($i <= 25000 && memory_get_usage() < 100000000)

In total my store has 1200 products. Is "25000" not enough?

 

By the way, before switching to ssl, it worked fine.

Edited December 24, 2015 by Tanatus (see edit history)

[Matthieu Malttt]

Hi everybody,

 

We produced a ready to work module for Prestashop sitemaps (working on 1.5 to latest 1.6 version) that supports multilanguages and multishop.

No worry about product limit, as products sitemaps are separated each 1000 products (you can change it as far as i remember, feel free to ask anyway).

 

It also provides (besides all requested features, like products, categories, suppliers, meta pages etc) blog modules integration. Currently supporting only PH Simple Blog & Advanced Blog but we can make it compatible with any other if you ask.

 

You can also add or ban any link you want from sitemaps.

 

You can get it here on Prestashop Addons : http://addons.presta...le-sitemap.html

 

Front office demo is available here : http://ps16last.agen...temap_index.xml

 

Feel free to ask anything if needed to improve it !

[doekia]

@Matthieu Malttt

Appart from posting a commercial for your module, did you try to understand the issue at first?

[Matthieu Malttt]

@Matthieu Malttt

Appart from posting a commercial for your module, did you try to understand the issue at first?

 

Maybe because :

- I read what he asked.

- Our module, which we worked hard on, is solving the problem ? 

- It's a good compromise.

- We will solve futher problems if you ask (kindly).

- We don't always see commercials as the horrible hand of capitalism making open source software slowly dying.

[Seirios]

My friend Tanatus,

 

I also have https on my back office but some modules don't work so well. Every time i want to change a setting in a problematic module i just

copy paste the backoffice url in another browser window and i delete the 's' from https.

So i enter my back office without security protocol and i make changes to those modules. Have you try this way ?

[doekia]

just for your information, the issue was related to wrong library with wrong php. I doubt that your module was able to fix that.

[Matthieu Malttt]

Maybe i can help here, just adjust memory limit in your hosting, SSL requires different parameters sometimes. Do you use private server (Apache / Nginx ? Php version ? FPM / FCGI ?) or mutualised hosting ?

 

The library is not used in our version, so yes it solves the problem. We managed to generate sitemap without files or cron, it's an auto updated one with cache. Writing a file was not reliable upon thousands of products. That's why there is a bug with the library you were talking about. Too much memory used.