How to fix Not Found Crawl errors from G.Analytics?

[SpyrosT]

Hi there

I am trying to find a solution on how to fix the "Not Found pages" from Google Analytics.

All the not found pages are having the same error which is a duplication of /shop/shop/
ie.
http://mydomain/shop/shop/
http://mydomain/shop/shop/authentication.php
etc.

Any idea??

[scottyboy]

I don't really understand why you want google to index your authentication.php page ?!!
Have you configured your robots.txt file properly. You MUST do this first if you want google to index your pages properly.
Use the 'allow' and 'disallow' commands to tell the web bots which parts of your site they should spider.

[SpyrosT]

I know that I have to configure my robots. For the moment is set to "allow all".
Iam looking to find a list of which pages must be set to disallow.

But I need to fix the duplication problem also.
Has anyone found the solution????

[scottyboy]

I'm almost certain that by implementing the following into your robots.txt that should solve the problem as the google bots are spidering files within your directory that contain duplicate static and dynamic content.



# Directories
Disallow: /classes/
Disallow: /config/
Disallow: /download/
Disallow: /mails/
Disallow: /modules/
Disallow: /themes/
Disallow: /translations/
Disallow: /tools/

# Files
Disallow: /addresses.php
Disallow: /address.php
Disallow: /authentication.php
Disallow: /cart.php
Disallow: /discount.php
Disallow: /footer.php
Disallow: /get-file.php
Disallow: /header.php
Disallow: /history.php
Disallow: /identity.php
Disallow: /images.inc.php
Disallow: /init.php
Disallow: /my-account.php
Disallow: /order.php
Disallow: /order-slip.php
Disallow: /order-detail.php
Disallow: /order-follow.php
Disallow: /order-return.php
Disallow: /order-confirmation.php
Disallow: /pagination.php
Disallow: /pdf-invoice.php
Disallow: /pdf-order-return.php
Disallow: /pdf-order-slip.php
Disallow: /product-sort.php
Disallow: /search.php
Disallow: /statistics.php
Disallow: /zoom.php

[SpyrosT]

Hi and thanks for your answer.
Is this the same list that the prestashop generator creates?

I have used the generator yesterday and now I am waiting for the next resault from Analytics.