Dimaer Posted June 28, 2010 Share Posted June 28, 2010 Hi guys,I wonder about hiding certain CMS pages for crawlers in robots.txt.I was looking for CMS file pages in Prestashop directory and cant find them...Is it possible to exclude some of these pages from search engines crawlers in robots.txt?Thanks. Link to comment Share on other sites More sharing options...
rocky Posted June 29, 2010 Share Posted June 29, 2010 Add the following to your robots.txt: Disallow: /cms.php?id_cms=1 Change 1 to the ID of the page you don't want crawled. You can copy this line as many times as needed with different IDs. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now