sampsonzak Posted March 31 Share Posted March 31 So I've had Google try and index/crawl ~2.2million pages, which are duplicates. I'm using PS default Robots.txt file (re-generated recently) on PS 1.7.8.8. But Google is indexing links, such as: www.mysite.com/?p=categories, etc. -- Seems to be indexing links, with multiple categories sorting, ordered by price, etc etc. www.mysite.com/page.html?aff= -- Affiliate plugin Should I be blocking ?aff, &aff, along with ?p, &p in the robots.txt file? Why is ?p, &p not enabled in Robots.txt by default by PrestaShop? Any help appreciated, as I don't want to harm my SEO with Google by doing so. Link to comment Share on other sites More sharing options...
Knowband Plugins Posted April 1 Share Posted April 1 14 hours ago, sampsonzak said: ?aff, &aff, This can be blocked in the robots.txt 14 hours ago, sampsonzak said: ?p, &p Share the example URL with the actual site URL for this one to check if the "p" param is useful for PS functionality OR it can be blocked. Link to comment Share on other sites More sharing options...
sampsonzak Posted April 1 Author Share Posted April 1 2 hours ago, Knowband Plugins said: This can be blocked in the robots.txt Share the example URL with the actual site URL for this one to check if the "p" param is useful for PS functionality OR it can be blocked. Here is an example of one of the links Google has indexed:https://airmodels.net/17-airlines?q=Categories-ANA-Jetstar+Airways-Singapore+Airlines-Turkmenistan+Airlines-Japan+Airlines/Availability-In+stock&page=2 It's indexing the /airline/ category, with a filter set of a few different airlines. It's not an airline's category page, but rather a filtered list of products, from ~5 different airlines, which are in stock, and on page number 2. Will this be harming my SEO? Should I disable all ?q= and &q= results? 38k indexed links from google, yet I have only 1.2k links in total on my website. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now