kbytin Posted March 30, 2014 Share Posted March 30, 2014 Automatically I get this robots.txt # robots.txt automaticaly generated by PrestaShop e-commerce open-source solution # http://www.prestashop.com - http://www.prestashop.com/forums # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # For more information about the robots.txt standard, see: # http://www.robotstxt.org/wc/robots.html User-agent: * # Private pages Disallow: /*orderby= Disallow: /*orderway= Disallow: /*tag= Disallow: /*id_currency= Disallow: /*search_query= Disallow: /*back= Disallow: /*n= Disallow: /*controller=addresses Disallow: /*controller=address Disallow: /*controller=authentication Disallow: /*controller=cart Disallow: /*controller=discount Disallow: /*controller=footer Disallow: /*controller=get-file Disallow: /*controller=header Disallow: /*controller=history Disallow: /*controller=identity Disallow: /*controller=images.inc Disallow: /*controller=init Disallow: /*controller=my-account Disallow: /*controller=order Disallow: /*controller=order-opc Disallow: /*controller=order-slip Disallow: /*controller=order-detail Disallow: /*controller=order-follow Disallow: /*controller=order-return Disallow: /*controller=order-confirmation Disallow: /*controller=pagination Disallow: /*controller=password Disallow: /*controller=pdf-invoice Disallow: /*controller=pdf-order-return Disallow: /*controller=pdf-order-slip Disallow: /*controller=product-sort Disallow: /*controller=search Disallow: /*controller=statistics Disallow: /*controller=attachment Disallow: /*controller=guest-tracking # Directories Disallow: */classes/ Disallow: */config/ Disallow: */download/ Disallow: */mails/ Disallow: */modules/ Disallow: */translations/ Disallow: */tools/ # Files Disallow: /*ru/address Disallow: /*ru/addresses Disallow: /*ru/authentication Disallow: /*ru/cart Disallow: /*ru/discount Disallow: /*ru/guest-tracking Disallow: /*ru/order-history Disallow: /*ru/identity Disallow: /*ru/my-account Disallow: /*ru/order Disallow: /*ru/ Disallow: /*ru/order-confirmation Disallow: /*ru/order-follow Disallow: /*ru/quick-order Disallow: /*ru/order-slip Disallow: /*ru/password-recovery Disallow: /*ru/search Disallow: /*uk/address Disallow: /*uk/addresses Disallow: /*uk/authentication Disallow: /*uk/cart Disallow: /*uk/discount Disallow: /*uk/guest-tracking Disallow: /*uk/order-history Disallow: /*uk/identity Disallow: /*uk/my-account Disallow: /*uk/order Disallow: /*uk/ Disallow: /*uk/order-confirmation Disallow: /*uk/order-follow Disallow: /*uk/quick-order Disallow: /*uk/order-slip Disallow: /*uk/password-recovery Disallow: /*uk/search And only after removing manually red lines google start to index my site Link to comment Share on other sites More sharing options...
Recommended Posts