.png.022b5452a8f28f552bc9430097a16da2.png)
How to update `robots.txt`? Seems Prestashop manages this itself
robots.txt was overwritten this morning and I see
# robots.txt automatically generated by PrestaShop e-commerce open-source solution
# http://www.prestashop.com - http://www.prestashop.com/forums
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html
User-agent: *
# Allow Directives
...
So how to add the following rule directly into the robots.txt file at the root of the site:
User-agent: OAI-SearchBot
Allow: /
This change should be safe, it doesn’t affect the security of the site, and it will significantly improve the site’s chances of appearing in new AI-driven search results.
