User-agent: *
Allow: /

Sitemap: https://docs.fastcrw.com/sitemap.xml

# CRW — Open-source Firecrawl alternative, self-hosted web scraper & crawler in Rust
