Jump to content

My site is crawled too fast and I got supended.


Recommended Posts

I don't know what to do with this issue. Please anyone can help me. My webhosting company suspended my site because of this quote:

"System administration has identified your account as using higher resources on the server housing your account. This is impacting other users, and we may be forced to suspend or have already suspended your site in order to stabilize the server.


We noticed that your site (Prestahsop based site), VARIABLE_1, is being heavily 'crawled' by search engines. Search engines tend to mimic the effect of hundreds of visitors going through every portion of your site, often all at once.


You may wish to implement a robots.txt file in order to reduce this effect. This file contains instructions for well behaving 'robots' on how to crawl your site. You can find more information about this here:



The basic format would be as follows to block robots from the following (example) directories:


User-agent: *

Disallow: /cgi-bin/

Disallow: /images/

Disallow: /tmp/

Disallow: /private/


To use this effectively, you will need to review your site and see what parts might be the most intensive. An alternative to blocking a search engine is to request their robots to not crawl through your site as quickly as they normally would. It is an unofficial extension to the robots.txt standard but one that most popular search engines use. This is an example of how you request robots request pages only every ten seconds:


User-agent: *

Crawl-delay: 10


This is especially useful for parts of your sites like forums or 'tag clouds' that, while useful to human visitors, are troublesome in terms of how robots aggressively pass through them repeatedly.


You can also use your access logs to see how search engines are hitting your site. Let us know if you need help finding your logs in our control panel and we'll be glad to help.


If your site is currently suspended, please contact us to lift the suspension in order to implement the above recommendation. As always, feel free to contact us with any further questions."

Would these recomendations really help? I have many problems with Prestashop SEO lately.

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
  • Create New...