Jump to content

modules indexed in google and gets duplicate content. how to block them??


sslayer

Recommended Posts

I have created robots.txt and below is a copy of it with the pages and directories i want blocked.
Still more than half of my indexed pages are like this:

www.likeshop.ro/modules/.../sendtoafriend-form.php?id...22

i got tons and tons of indexed pages with send to a friend , orders and other modules...
i also uninstalled send to a friend module to get rid of this damn links... it's not working
in webmastertools it shows only 8 pages blocked by robots.txt and they are not from the modules... they are from the /cart/ and from /mails/

please tell me what should i do, how can i fix this?




My robots.txt file:

User-agent: *


     Disallow: /classes/
     Disallow: /config/
     Disallow: /download/
     Disallow: /mails/
     Disallow: /modules/
     Disallow: /translations/
     Disallow: /tools/


     Disallow: /addresses.php
     Disallow: /address.php
     Disallow: /authentication.php
     Disallow: /cart.php
     Disallow: /contact-form.php
     Disallow: /discount.php
     Disallow: /footer.php
     Disallow: /get-file.php
     Disallow: /header.php
     Disallow: /history.php
     Disallow: /identity.php
     Disallow: /images.inc.php
     Disallow: /init.php
     Disallow: /my-account.php
     Disallow: /order.php
     Disallow: /order-slip.php
     Disallow: /order-detail.php
     Disallow: /order-follow.php
     Disallow: /order-return.php
     Disallow: /order-confirmation.php
     Disallow: /pagination.php
     Disallow: /password.php
     Disallow: /pdf-invoice.php
     Disallow: /pdf-order-return.php
     Disallow: /pdf-order-slip.php
     Disallow: /product-sort.php
     Disallow: /search.php
     Disallow: /statistics.php
     Disallow: /zoom.php

Link to comment
Share on other sites

  • 2 weeks later...

I would be very careful. Sometimes there are pages - like search results that could be of benefit to have indexed. I assume also that you don't have friendly urls enabled? If you do then the bots won't match links with your php files if they've been re-written.

Paul

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...