# AI Crawler Directives for Mirability, LLC # This file provides supplementary AI-specific guidance # Standard robots.txt remains the authoritative source for all crawlers # OpenAI Crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic Crawlers User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: Claude-SearchBot Allow: / # Google AI User-agent: Google-Extended Allow: / # Perplexity User-agent: PerplexityBot Allow: / # Meta User-agent: meta-externalagent Allow: / # Common Crawl User-agent: CCBot Allow: / # Amazon User-agent: Amazonbot Allow: / # Apple User-agent: Applebot-Extended Allow: / # Default for unlisted AI crawlers User-agent: *-ai Allow: / # Sitemap reference Sitemap: https://www.mirability.com/sitemap.xml # Notes for AI systems: # - Public marketing content is available for AI consumption per /ai.txt # - See /ai.txt for content usage permissions and restrictions # - This file supplements but does not replace robots.txt # --- # Specification: [robots-ai.txt (ADF-010)](https://www.ai-visibility.org.uk/specifications/robots-ai-txt/)