Jump to content

Hiding certain CMS pages for crawlers in robots.txt?


Recommended Posts

Hi guys,
I wonder about hiding certain CMS pages for crawlers in robots.txt.
I was looking for CMS file pages in Prestashop directory and cant find them...
Is it possible to exclude some of these pages from search engines crawlers in robots.txt?
Thanks.

Share this post


Link to post
Share on other sites

Add the following to your robots.txt:

Disallow: /cms.php?id_cms=1



Change 1 to the ID of the page you don't want crawled. You can copy this line as many times as needed with different IDs.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share

×
×
  • Create New...

Important Information

Cookies ensure the smooth running of our services. Using these, you accept the use of cookies. Learn More