# Pinafly. The policy and the reasoning live in lib/docs/SEO.md. # # Snapshots and review links (/bzz) are noindex by response header (spec 041). They are # deliberately NOT disallowed here: a crawler that cannot fetch the page never sees the header. User-agent: * Allow: / # Search and citation bots: allowed, because blocking them removes us from answers. User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / Sitemap: https://pinafly.com/sitemap.xml