User-agent: * Allow: / # Don't crawl internal endpoints if accessed at root Disallow: /api/ Disallow: /admin/ Disallow: /webhook Disallow: /demo/web-call # Explicitly welcome AI / LLM crawlers (they also match * above). # Same content access, same internal-endpoint exclusions. User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Google-Extended User-agent: GoogleOther User-agent: ClaudeBot User-agent: anthropic-ai User-agent: Claude-Web User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Applebot-Extended User-agent: cohere-ai User-agent: Meta-ExternalAgent User-agent: Amazonbot User-agent: Bytespider User-agent: DuckAssistBot User-agent: YouBot User-agent: CCBot Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /webhook Disallow: /demo/web-call # AI guidance file: https://deskgreet.com/llms.txt Sitemap: https://deskgreet.com/sitemap.xml