Rhobur Posted March 8, 2011 Share Posted March 8, 2011 How can I stop google crawling a category of products which is not visible anymore, meaning it exists in DB but not displayed on site. I'm hesitating to delete it because I may need it again sometime ? Link to comment Share on other sites More sharing options...
Rhobur Posted March 8, 2011 Author Share Posted March 8, 2011 Thank you, I will try this though I've read somewhere that this isn't always stopping the google bots.I'll see what happens the next few days and then confirm this solution. Link to comment Share on other sites More sharing options...
Rhobur Posted March 8, 2011 Author Share Posted March 8, 2011 Wait a minute, how to disallow a category in robots.txt ? Link to comment Share on other sites More sharing options...
Rhobur Posted March 9, 2011 Author Share Posted March 9, 2011 Thank you, ippr123 but would I do that exactly ? Let's say that I have a category with id = 45 which is now deactivated and not appearing on the site menu; how do I restrict it in the robots.txt ? Link to comment Share on other sites More sharing options...
theodoreenfield Posted March 10, 2011 Share Posted March 10, 2011 Use robots.txt file to hide from crawling it ...Affordable Seo Services Link to comment Share on other sites More sharing options...
Rhobur Posted March 11, 2011 Author Share Posted March 11, 2011 And if I want to restrict a whole category which appears on google webmaster as www.caprice-shop.ro/category-1/blablabla, I should put Disallow:/category-1/ in robots.txt ?I'm asking this because evidently , category-1 is not a folder, is a category presently deactivated.I appreciate your help. Link to comment Share on other sites More sharing options...
inveostore.com Posted March 11, 2011 Share Posted March 11, 2011 And if I want to restrict a whole category which appears on google webmaster as www.caprice-shop.ro/category-1/blablabla, I should put Disallow: /category-1/ in robots.txt ? This code disallow all URLs which begin with /category-1/. It depends on your SEO URL formats whether it disallows not only category page but also pages inside this category. Link to comment Share on other sites More sharing options...
Rhobur Posted March 12, 2011 Author Share Posted March 12, 2011 inveostore, by pages inside this category you mean only the pages of the products of this category ? Link to comment Share on other sites More sharing options...
inveostore.com Posted March 12, 2011 Share Posted March 12, 2011 I mean both: products/categories inside this category. It all matter on SEO URLs formats. I would suggest you to read something about robots.txt file at http://www.robotstxt.org/ if you do not understand. Link to comment Share on other sites More sharing options...
highlandspring Posted March 30, 2011 Share Posted March 30, 2011 There is also an option in Google Webmaster Tools to remove specific urls from a website. That will only help with Google though, not Bing etc Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now