Ryx Posted October 2, 2012 Share Posted October 2, 2012 Hi I've created a robots.txt file. Main purpose is to keep bots from indexing my test-shop. Please verify that I have done this correct. Real shop: http://www.mumuland.dk/shop Test shop: http://test.mumuland.dk/shop robots.txt file is located in root folder: http://www.mumuland.dk/robots.txt Content of robots.txt below - I've highligthed in red what I think is the right thing to put in in order to keep bots off my test-shop Thank you in advance /Ryx # robots.txt automaticaly generated by PrestaShop e-commerce open-source solution # http://www.prestashop.com - http://www.prestashop.com/forums # This file is to prevent the crawling and indexing of certain parts # of your site by web crawlers and spiders run by sites like Yahoo! # and Google. By telling these "robots" where not to go on your site, # you save bandwidth and server resources. # For more information about the robots.txt standard, see: # http://www.robotstxt.org/wc/robots.html # GoogleBot specific User-agent: Googlebot Disallow: /shop/*orderby= Disallow: /shop/*orderway= Disallow: /shop/*tag= Disallow: /shop/*id_currency= Disallow: /shop/*search_query= Disallow: /shop/*id_lang= Disallow: /shop/*back= Disallow: /shop/*utm_source= Disallow: /shop/*utm_medium= Disallow: /shop/*utm_campaign= Disallow: /shop/*n= # All bots User-agent: * # Directories Disallow: /test/ Disallow: /shop/classes/ Disallow: /shop/config/ Disallow: /shop/download/ Disallow: /shop/mails/ Disallow: /shop/modules/ Disallow: /shop/translations/ Disallow: /shop/tools/ # Files Disallow: /shop/addresses.php Disallow: /shop/address.php Disallow: /shop/authentication.php Disallow: /shop/cart.php Disallow: /shop/discount.php Disallow: /shop/footer.php Disallow: /shop/get-file.php Disallow: /shop/header.php Disallow: /shop/history.php Disallow: /shop/identity.php Disallow: /shop/images.inc.php Disallow: /shop/init.php Disallow: /shop/my-account.php Disallow: /shop/order.php Disallow: /shop/order-opc.php Disallow: /shop/order-slip.php Disallow: /shop/order-detail.php Disallow: /shop/order-follow.php Disallow: /shop/order-return.php Disallow: /shop/order-confirmation.php Disallow: /shop/pagination.php Disallow: /shop/password.php Disallow: /shop/pdf-invoice.php Disallow: /shop/pdf-order-return.php Disallow: /shop/pdf-order-slip.php Disallow: /shop/product-sort.php Disallow: /shop/search.php Disallow: /shop/statistics.php Disallow: /shop/attachment.php Disallow: /shop/guest-tracking.php Disallow: /shop/address Disallow: /shop/adresse Disallow: /shop/direccion Disallow: /shop/adresse Disallow: /shop/indirizzo Disallow: /shop/address Disallow: /shop/addresses Disallow: /shop/adresses Disallow: /shop/direcciones Disallow: /shop/adressen Disallow: /shop/indirizzi Disallow: /shop/addresses Disallow: /shop/authentication Disallow: /shop/authentification Disallow: /shop/autenticacion Disallow: /shop/authentifizierung Disallow: /shop/autenticazione Disallow: /shop/authentication Disallow: /shop/cart Disallow: /shop/panier Disallow: /shop/carro-de-la-compra Disallow: /shop/warenkorb Disallow: /shop/carrello Disallow: /shop/cart Disallow: /shop/discount Disallow: /shop/bons-de-reduction Disallow: /shop/descuento Disallow: /shop/discount Disallow: /shop/sconto Disallow: /shop/discount Disallow: /shop/guest-tracking Disallow: /shop/suivi-commande-invite Disallow: /shop/estado-pedido Disallow: /shop/auftragsverfolgung-gast Disallow: /shop/ospite-monitoraggio Disallow: /shop/guest-tracking Disallow: /shop/order-history Disallow: /shop/historique-des-commandes Disallow: /shop/historial-de-pedidos Disallow: /shop/bestellungsverlauf Disallow: /shop/storico-ordine Disallow: /shop/order-history Disallow: /shop/identity Disallow: /shop/identite Disallow: /shop/identidad Disallow: /shop/kennung Disallow: /shop/identita Disallow: /shop/identity Disallow: /shop/my-account Disallow: /shop/mon-compte Disallow: /shop/mi-cuenta Disallow: /shop/mein-Konto Disallow: /shop/il-mio-account Disallow: /shop/my-account Disallow: /shop/order Disallow: /shop/commande Disallow: /shop/carrito Disallow: /shop/bestellung Disallow: /shop/ordine Disallow: /shop/order Disallow: /shop/order-follow Disallow: /shop/details-de-la-commande Disallow: /shop/devolucion-de-productos Disallow: /shop/bestellungsverfolgung Disallow: /shop/seguito-ordine Disallow: /shop/order-follow Disallow: /shop/quick-order Disallow: /shop/commande-rapide Disallow: /shop/pedido-rapido Disallow: /shop/schnell-bestellung Disallow: /shop/ordine-veloce Disallow: /shop/quick-order Disallow: /shop/order-slip Disallow: /shop/avoirs Disallow: /shop/vales Disallow: /shop/bestellschein Disallow: /shop/nota-di-ordine Disallow: /shop/order-slip Disallow: /shop/password-recovery Disallow: /shop/mot-de-passe-oublie Disallow: /shop/contrasena-olvidado Disallow: /shop/kennwort-wiederherstellung Disallow: /shop/password-recupero Disallow: /shop/password-recovery Disallow: /shop/search Disallow: /shop/recherche Disallow: /shop/buscar Disallow: /shop/suche Disallow: /shop/cerca Disallow: /shop/search # Sitemap Link to comment Share on other sites More sharing options...
El Patron Posted October 6, 2012 Share Posted October 6, 2012 as you test shop is a stand alone site (as viewed by bots).. you really on need this in your robot.txt file User-agent: * Disallow: /* also to really keep them out...just put your test site in maint. mode. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now