4GLte.eu Posted July 24, 2017 Share Posted July 24, 2017 Does anyone have an idea why I have such crawl URL errors? e.g. /category/domain/link_link_to_the_product (the last part is valid and works but not with the category beginning) en/rf-cables/www.4glte.eu/en/rf-cables/881-coaxial-cable-rg178-rp-sma-female-to-right-angle-mcx-male-15cm-5081947572022.html gb/mobile-internet/www.4glte.eu/de/mobile-internet/1194-huawei-b310-lte-cpe-router-white-1469267604618.html en/switches/www.4glte.eu/es/switches/1440-ubiquiti-edgeswitch-8-port-poe-switch-es-8-150w-5395481474880.html en/routers/www.4glte.eu/de/routers/1289-anti-virus-dt-dt-for-vigorpro-5510-5395481389719.html gb/others/www.4glte.eu/es/others/420-original-battery-for-huawei-e5172-4g-lte-cpe-5081947569633.html Any idea what is generating this ? Link to comment Share on other sites More sharing options...
Scully Posted July 24, 2017 Share Posted July 24, 2017 URLs seem to be totally wrong. They must start with the domain. Post a link to your sitemap file if errors come from real crawlerd like bing or google. If its not a major search engine, just forget it. There are too many poorly programmed crawlers running out there. Link to comment Share on other sites More sharing options...
4GLte.eu Posted July 25, 2017 Author Share Posted July 25, 2017 http://www.4glte.eu/2_index_sitemap.xml Link to comment Share on other sites More sharing options...
Scully Posted July 26, 2017 Share Posted July 26, 2017 have you checked the ip addresses of the 404 requests. what kind of service / host? is it a real search engine? Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now