Jump to content

SEO tools giving 404 errors when crawling site (PS 1.6)

Recommended Posts


I have a strange problem which I've been trying to troubleshoot - I've found similar issues online, but not the specific one I'm having.

I'm trialling several SEO tools (Moz, SEMrush, ahrefs), and when they crawl my site (https://accessoriesforthehome.co.uk), I'm getting loads of weird 404 URLs listed in the results.

It's something to do with relative links I think, as it seems to be adding an incorrect path to the URL.

Here's an example:




The actual URL for this page is https://accessoriesforthehome.co.uk/content/2-privacy-policy

I get over 22k bad URLs from one of the crawlers and they all seem to be linked to the 2-privacy-policy document which is just a standard CMS page with no weird code in it. The other CMS pages don't appear to cause the same issue (although I'll admit I've not checked all 22k bad links!)

Fortunately, Google Search Console does not appear to be seeing these bad links, but it's a concern as to why the SEO crawlers are.

Has anyone experienced anything like this?




Share this post

Link to post
Share on other sites

Found it:

It was a link in the content used by the UECookie module which was a relative link and therefore being picked up on every page of the crawl incorrectly!

Hope this helps someone else!


Share this post

Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Create New...

Important Information

Cookies ensure the smooth running of our services. Using these, you accept the use of cookies. Learn More