ai.robots.txt
Community-maintained list of AI bots to block. Generates robots.txt, .htaccess, nginx, HAProxy configs.
- Category
- AI Crawler Management
- Repository
- ai-robots-txt/ai.robots.txt
- Type
- Reference
- Language
- Python
- License
- MIT
- Stars
- 4,256
- Last push
- 2026-11-05
- Maintained
- Yes
Related repos in this category
All 4 GEOInflow Self-hosted analytics for AI crawler visits, AI search referrals, server crawl logs and content coverage. 836 AI Training Opt-Out Unmaintained Reference repo for AI training opt-out tags, headers, robots.txt directives, and .well-known patterns. 160 geo-monitor Self-hosted AI crawler monitor that reads Nginx or OpenResty access logs and verifies crawler sources. README mostly in Chinese. 99