felix0918 Posted March 6, 2020 Share Posted March 6, 2020 (edited) Hi, I'm having issues with my website : https://cosmicgroove.fr Google bot has been detecting 5xx errors all over my website since the middle of January : I didn't change anything before it happened and because of this issue, my website disappeared from google results. The website works just fine and there's no visible issues, I tried removing .htaccess file and disabling recent modules but nothing changed. Please help me out... Edited March 6, 2020 by felix0918 (see edit history) Link to comment Share on other sites More sharing options...
tomerg3 Posted March 6, 2020 Share Posted March 6, 2020 Can you provide examples of some of the URLs Google complained about? Link to comment Share on other sites More sharing options...
felix0918 Posted March 6, 2020 Author Share Posted March 6, 2020 16 minutes ago, tomerg3 said: Can you provide examples of some of the URLs Google complained about? Homepage as well as those and many others : https://cosmicgroove.fr/en/content/3-conditions-utilisationhttps://cosmicgroove.fr/en/50-programmehttps://cosmicgroove.fr/fr/accessoires/77-tote-bag-vinyl-appreciation-society.htmlhttps://cosmicgroove.fr/en/6-label Link to comment Share on other sites More sharing options...
tomerg3 Posted March 6, 2020 Share Posted March 6, 2020 Looks like your robots.txt is blocking the crawl Link to comment Share on other sites More sharing options...
felix0918 Posted March 6, 2020 Author Share Posted March 6, 2020 (edited) 6 minutes ago, tomerg3 said: Looks like your robots.txt is blocking the crawl Here is the robots.txt file, it doesn't seem to be blocking it robots.txt Edited March 6, 2020 by felix0918 (see edit history) Link to comment Share on other sites More sharing options...
tomerg3 Posted March 6, 2020 Share Posted March 6, 2020 If the Google tool says your robots.txt is blocking them, they are likely right. Try using the tool I did above, so you can check in real time, and first try to rename the file, and see if that changes the result. If it does, you should try to isolate the part that is blocking them, I would start by removing User-agent: MJ12bot Disallow: / Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now