You must log in or register to comment.
You should put these entries into your robots.txt file.
To block the Google search crawler use for all of your site:
User-agent: Googlebot
Disallow: /
To block the Google AI crawler use:
User-agent: Google-Advanced
Disallow: /
You rock, thank you!
What if I made a static site using Github pages hosting? Will having a robots.txt in my root folder ward off Google bhoots (devils)?
Yes.
