Want to stop AI from crawling your website?
Pull this robots.txt into your own on occasion.
NOTE: it's changing frequently, so pull often
https://raw.githubusercontent.com/ai-robots-txt/ai.robots.txt/main/robots.txt
Pull this robots.txt into your own on occasion.
NOTE: it's changing frequently, so pull often
https://raw.githubusercontent.com/ai-robots-txt/ai.robots.txt/main/robots.txt