4GLte.eu Posted June 30, 2017 Share Posted June 30, 2017 Hi all, I am having a lot of crawl errors - not found 404 The problem is that indeed the page does not exits but the link is wrong: e.g. www.mydomain/fr/mobile-internet/www.mydomain/pl/mobile-internet/607-huawei-e3372h-153-4 Do you have any idea why and where the crawl is taking such a link from? Link to comment Share on other sites More sharing options...
Scully Posted June 30, 2017 Share Posted June 30, 2017 It depends: What crawler or crawlers are fetching these wrong URLs ?? If it is google, it would care since then something might be wrong with your site. If it is any unknown crawler, I would not care. Why not in the 2nd case? Everyone is programming crawlers in these days - even people who might not be supposed to do so. Many of them have plenty of bugs in the URL building process. In this case, it is not YOUR problem. Tipp: Google the wrong links by copy paste into google search. If it finds some of them, take a closer look. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now