update robots.txt

[rhandom]

How to update `robots.txt`? Seems Prestashop manages this itself

robots.txt was overwritten this morning and I see

# robots.txt automatically generated by PrestaShop e-commerce open-source solution
# http://www.prestashop.com - http://www.prestashop.com/forums
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html
User-agent: *
# Allow Directives
...

So how to add the following rule directly into the robots.txt file at the root of the site:

User-agent: OAI-SearchBot
Allow: /

This change should be safe, it doesn’t affect the security of the site, and it will significantly improve the site’s chances of appearing in new AI-driven search results.

Edited August 25 by rhandom (see edit history)

[rhandom]

Guess I can add after generation myself. Did add

# OpenAI Search Bot
User-agent: OAI-SearchBot
Allow: /

at the end of the file.

Only thing I worry about is that this is inside the current directory so Git overwrites will overwrite it. But I think I can merge from platform control panel 

Edited August 25 by rhandom (see edit history)