x3n0m0rph Posted February 9, 2015 Share Posted February 9, 2015 Hi, I am having some strange problems with robots.txt. I went to webmaster tools and seen a warning - sitemap blocked by robots.txt. Went to sitemap section and the end of the sitemap looks like this: # Files Disallow: /ti-ai-uitat-parola Disallow: /quick-order Disallow: /guest-tracking Disallow: / Disallow: / Disallow: / Disallow: / Disallow: / Disallow: / Disallow: / Disallow: / Disallow: / Disallow: / Disallow: / Disallow: / I also have html errors for some products that seemed to be restricted and 1312 warnings in sitemap section saying: Url blocked by robots.txt - http://www.secretgarden.ro/1000-large_default/jerba-din-crizantema-alba-si-galbena.jpg For the moment, I manualy edited robots.txt and deleted all Disallow: / I tryed to regenerate robots.txt and sitemap - regenerated robots.txt is the same. I also restanted/ uninstall / replaced sitemap module - same result Why is my robots.txt broken? How can I fix it? Please help! Link to comment Share on other sites More sharing options...
ReactionCode Posted February 10, 2015 Share Posted February 10, 2015 Hi It's easy to fix. You can generate a new robots.txt In your backoffice go to Preferences->SEO + URLs" at the bottom of the page you'll find the button "Generate robots.txt file" This button will erase your old robots.txt. Link to comment Share on other sites More sharing options...
x3n0m0rph Posted February 10, 2015 Author Share Posted February 10, 2015 As I sad, already tried that! Any other solution please? Link to comment Share on other sites More sharing options...
ReactionCode Posted February 11, 2015 Share Posted February 11, 2015 (edited) If you have a problem with the robots generation. you have to check the function public function generateRobotsFile() you will find in mysite.com/controllers/admin/AdminMetaController.php Overwrite the file from a clean PS folder. also check if you have any override in mysite.com/override/controllers/admin/AdminMetaController.php Edited February 11, 2015 by javsmile (see edit history) Link to comment Share on other sites More sharing options...
x3n0m0rph Posted February 11, 2015 Author Share Posted February 11, 2015 Done that, disabled overrides and nonnative modules, clear cache, regenerate robots.txt - same problem... My site already droped from google first page on keywords.... I really need a solution... For the moment, I disabled sitemap module (it seems to regenerate robots.thx with the sitemap) and manualy edited robots.txt ... Please help... Link to comment Share on other sites More sharing options...
x3n0m0rph Posted February 11, 2015 Author Share Posted February 11, 2015 I realy need help with this.. Link to comment Share on other sites More sharing options...
x3n0m0rph Posted February 11, 2015 Author Share Posted February 11, 2015 This issue seems to be conected with friendly url - this section of robots.txt appears only when friendly url are enabled I still need help with this... Link to comment Share on other sites More sharing options...
x3n0m0rph Posted February 11, 2015 Author Share Posted February 11, 2015 And.. I am back with the solution: This was a bug related to languages and friendly url activation. When you install prestashop you have multiple labguages. If you want to use only one language, like I do, you will deactivate other languages and delete them. This leaves some entries in yourdatabase -> ps_meta_lang -> there you will have entries with "NULL" in url_rewrite column. If you delete all this entries your robots.txt will be generated corectly next time. PS: This forum becomes useless, since people are not interested in helping each other anymore. 2 Link to comment Share on other sites More sharing options...
ReactionCode Posted February 11, 2015 Share Posted February 11, 2015 As far I know Sitemap module dont have any relation with robots.txt generation. you overwritte the controller how I told you? Note that, when you do that, remember to delete the class_index.php from cache folder. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now