# Fanaura robots.txt # Search engines and AI assistants may read every public page. # A crawler follows only the most specific group that names it, so every # named crawler shares the same rules as the default group. User-agent: * User-agent: Googlebot User-agent: Google-Extended User-agent: GoogleOther User-agent: Bingbot User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Claude-Web User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Applebot User-agent: Applebot-Extended User-agent: meta-externalagent User-agent: meta-externalfetcher User-agent: FacebookBot User-agent: Amazonbot User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: cohere-ai User-agent: CCBot User-agent: YouBot User-agent: Bytespider Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /private/ Sitemap: https://www.fanaura.com/sitemap.xml # A plain-language summary of Fanaura for AI assistants: # https://www.fanaura.com/llms.txt