# robots.txt for WhiteRank # Allow search engines and AI discovery crawlers User-agent: * Allow: / # AI & search crawlers (explicit allow product depends on AI visibility) User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: ClaudeBot User-agent: Claude-Web User-agent: Google-Extended User-agent: Googlebot User-agent: Bingbot Allow: / Sitemap: https://whiterank.io/sitemap-index.xml