Edit Robots.txt on dog store

[versai8]

How i can edit robots.txt file and remove some unwanted page to be crawled?

can indexed page be de indexed after robots.txt updated.

 

How to make dog site secure from DDos attack and bots?    

Need your answer.

 

Edited August 16, 2022 by versai8 (see edit history)

[webprog]

You can edit robots.txt file using text editor like notepad.

File is in the file catalog of your folder shop. So, use hosting panel or ftp manager to edit it.

You can remove some unwanted pages using Disallow: tag, for example:

Disallow: /classes/

Also, you can remove CMS pages from index using back office, in the settings of the CMS page.

On 8/15/2022 at 5:18 AM, versai8 said:

can indexed page be de indexed after robots.txt updated.

Yes, but you need to reload robots.txt in google webmaster. Also you can remove url in google webmaster too.

[versai8]

43 minutes ago, webprog said:

You can edit robots.txt file using text editor like notepad.

File is in the file catalog of your folder shop. So, use hosting panel or ftp manager to edit it.

You can remove some unwanted pages using Disallow: tag, for example:

Disallow: /classes/

Also, you can remove CMS pages from index using back office, in the settings of the CMS page.

Yes, but you need to reload robots.txt in google webmaster. Also you can remove url in google webmaster too.

AGAIN RE SUBMIT ROBOTS.TXT OR SITEMAP IN GSC.

[Zohaib-fk]

Add sitemap URL in robots.txt file like below example.

Sitemap: https://www.hrms-systems.com/sitemap.xml

You can submit both robots.txt and sitemap in google search console.