ai.robots.txt

ai.robots.txt is a reference resource in the AI Crawler Management category of Generative Engine Optimization resources. it has 3,778 stars on GitHub and is actively maintained.

Community-maintained list of AI bots to block. Generates robots.txt, .htaccess, nginx, HAProxy configs.

This resource is part of the Awesome GEO curated collection — a hand-picked set of open-source tools, libraries, research papers, and frameworks for optimizing web presence across AI search engines like ChatGPT, Perplexity, Gemini, and Claude.