# Standard crawlers — block context.md from appearing in search results User-agent: * Allow: / Disallow: /Admin* Disallow: /context.md Disallow: /6114f0d64bf342a58772514d7b72c70b Crawl-delay: 0 # AI / LLM crawlers — explicitly allowed User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Googlebot Allow: / Disallow: /context.md User-agent: Bingbot Allow: / Disallow: /context.md User-agent: OAI-SearchBot Allow: / User-agent: cohere-ai Allow: / User-agent: Diffbot Allow: / # Sitemaps Sitemap: https://e-sharp.co/sitemap.xml Sitemap: https://e-sharp.co/sitemap # LLM context file — allowed for AI/LLM crawlers only, not for search indexing # llms.txt: https://e-sharp.co/llms.txt # context.md: https://e-sharp.co/context.md