Jump to content

Sitemap GSC - URL bloquée par le fichier robots.txt.


Recommended Posts

Bonjour,

J'ai lancé ma boutique Prestashop version 1.7.0.2 lundi dernier.

J'ai soumis le sitemap à Google Search Console ==> 116 URL

Quelques jours après, j'ai 116 avertissements, au niveau du sitemap dans Google Search Console, notés "URL bloquée par le fichier robots.txt".

Quand je fais sur Google site:https://monsite.com, j'ai 53 URL indexées.

 

Est-ce que vous pensez qu'il y a un problème ?

Merci

 

Robot.txt

# robots.txt automatically generated by PrestaShop e-commerce open-source solution
# http://www.prestashop.com - http://www.prestashop.com/forums
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html
User-agent: *
# Allow Directives
Allow: */modules/*.css
Allow: */modules/*.js
Allow: */modules/*.png
Allow: */modules/*.jpg
# Private pages
Disallow: /*?orderby=
Disallow: /*?orderway=
Disallow: /*?tag=
Disallow: /*?id_currency=
Disallow: /*?search_query=
Disallow: /*?back=
Disallow: /*?n=
Disallow: /*&orderby=
Disallow: /*&orderway=
Disallow: /*&tag=
Disallow: /*&id_currency=
Disallow: /*&search_query=
Disallow: /*&back=
Disallow: /*&n=
Disallow: /*controller=addresses
Disallow: /*controller=address
Disallow: /*controller=authentication
Disallow: /*controller=cart
Disallow: /*controller=discount
Disallow: /*controller=footer
Disallow: /*controller=get-file
Disallow: /*controller=header
Disallow: /*controller=history
Disallow: /*controller=identity
Disallow: /*controller=images.inc
Disallow: /*controller=init
Disallow: /*controller=my-account
Disallow: /*controller=order
Disallow: /*controller=order-slip
Disallow: /*controller=order-detail
Disallow: /*controller=order-follow
Disallow: /*controller=order-return
Disallow: /*controller=order-confirmation
Disallow: /*controller=pagination
Disallow: /*controller=password
Disallow: /*controller=pdf-invoice
Disallow: /*controller=pdf-order-return
Disallow: /*controller=pdf-order-slip
Disallow: /*controller=product-sort
Disallow: /*controller=search
Disallow: /*controller=statistics
Disallow: /*controller=attachment
Disallow: /*controller=guest-tracking
# Directories
Disallow: */cache/
Disallow: */classes/
Disallow: */config/
Disallow: */controllers/
Disallow: */css/
Disallow: */download/
Disallow: */js/
Disallow: */localization/
Disallow: */log/
Disallow: */mails/
Disallow: */modules/
Disallow: */override/
Disallow: */pdf/
Disallow: */src/
Disallow: */tools/
Disallow: */translations/
Disallow: */upload/
Disallow: */vendor/
Disallow: */web/
Disallow: */webservice/
# Files
Disallow: /recuperation-mot-de-passe
Disallow: /adresse
Disallow: /adresses
Disallow: /connexion
Disallow: /panier
Disallow: /reduction
Disallow: /historique-commandes
Disallow: /identite
Disallow: /mon-compte
Disallow: /suivi-commande
Disallow: /avoirs
Disallow: /commande
Disallow: /recherche
Disallow: /suivi-commande-invite
Disallow: /confirmation-commande

 

 

Edited by Caroline (see edit history)

Share this post


Link to post
Share on other sites

Bah oui, puisque GSC le dit :)

Googlebot doit être capable de lire TOUS les fichiers nécessaires à la construction de la page, comme le ferait le navigateur d'un visiteur réel. En conséquence, il faut autoriser la lecture des JS, CSS, et images des modules

Share this post


Link to post
Share on other sites

Bonjour et merci Johann pour votre réponse.

Dans mon robot.txt j'ai

Allow: */modules/*.css
Allow: */modules/*.js
Allow: */modules/*.png
Allow: */modules/*.jpg

 

Ce n'est pas suffisant ?

Si non que faut-il que je fasse en plus ?

Merci pour votre aide

Share this post


Link to post
Share on other sites
  • 4 months later...

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...

Important Information

Cookies ensure the smooth running of our services. Using these, you accept the use of cookies. Learn More