Jump to content

Google Blocked by Robots


Ben90

Recommended Posts

Hi guys,

 

I'm using prestashop 1.6 and I realise robots.txt made the site blocked by Googlebot. I check robots.txt and I reckon it's alright. This is the screenshot of the error I got. We are on the page 1 of Google before, suddenly because of this thing, we are going down to second page.

 

Please kindly take a look. Any advice would be appreciated. Maybe for temporary I need to delete the sitemap url inside robots.txt

 

https://www.dropbox.com/s/62iavdbi2hi8vht/sitemap-test-result.JPG?dl=0

https://www.dropbox.com/s/nb7tvw1y6tjfk4t/blocked-by-robots.JPG?dl=0

 

Is there something wrong with my robots or sitemap?

# robots.txt automaticaly generated by PrestaShop e-commerce open-source solution
# http://www.prestashop.com - http://www.prestashop.com/forums
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/wc/robots.html
User-agent: *
# Private pages
Disallow: /*orderby=
Disallow: /*orderway=
Disallow: /*tag=
Disallow: /*id_currency=
Disallow: /*search_query=
Disallow: /*back=
Disallow: /*n=
Disallow: /*controller=addresses
Disallow: /*controller=address
Disallow: /*controller=authentication
Disallow: /*controller=cart
Disallow: /*controller=discount
Disallow: /*controller=footer
Disallow: /*controller=get-file
Disallow: /*controller=header
Disallow: /*controller=history
Disallow: /*controller=identity
Disallow: /*controller=images.inc
Disallow: /*controller=init
Disallow: /*controller=my-account
Disallow: /*controller=order
Disallow: /*controller=order-opc
Disallow: /*controller=order-slip
Disallow: /*controller=order-detail
Disallow: /*controller=order-follow
Disallow: /*controller=order-return
Disallow: /*controller=order-confirmation
Disallow: /*controller=pagination
Disallow: /*controller=password
Disallow: /*controller=pdf-invoice
Disallow: /*controller=pdf-order-return
Disallow: /*controller=pdf-order-slip
Disallow: /*controller=product-sort
Disallow: /*controller=search
Disallow: /*controller=statistics
Disallow: /*controller=attachment
Disallow: /*controller=guest-tracking
# Directories
Disallow: */classes/
Disallow: */config/
Disallow: */download/
Disallow: */mails/
Disallow: */modules/
Allow: */modules/homesliderpro/images
Allow: */modules/homesliderpro/icons
Disallow: */translations/
Disallow: */tools/
# Files
Disallow: /forgot-your-password
Disallow: /address
Disallow: /addresses
Disallow: /authentication
Disallow: /cart
Disallow: /discount
Disallow: /order-history
Disallow: /identity
Disallow: /my-account
Disallow: /order-follow
Disallow: /order-slip
Disallow: /order
Disallow: /search
Disallow: /quick-order
Disallow: /guest-tracking
Disallow: /marbleceramiccorp
# Sitemap
Sitemap: https://www.marbleceramiccorp.com.au/sitemap.xml
Edited by Ben90 (see edit history)
Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...