Firecrawl
Web data API for AI — turn websites into LLM-ready markdown. llms.txt generation built in.
- Category
- llms.txt Ecosystem
- Repository
- firecrawl/firecrawl
- Type
- Tool
- Language
- TypeScript
- License
- AGPL-3.0
- Stars
- 201,014
- Last push
- 2026-11-11
- Maintained
- Yes
Related repos in this category
All 12 llms.txt Specification The official llms.txt spec by Jeremy Howard. The standard for making your site AI-readable. 2.7k llms-txt-hub Largest directory of sites implementing llms.txt — reference list and tooling. 926 vitepress-plugin-llms VitePress plugin that generates llms.txt, llms-full.txt, and Markdown versions of each docs page at build time. 415 create-llmstxt-py Unmaintained Firecrawl Python generator for producing llms.txt files from websites. 327