# KAU Me-LON (www.agrinoteskau.com) # Policy: be FOUND in Google and in AI search results, but do not let AI # systems train on, fetch on demand, or summarise the content. # Cloudflare content signals (https://contentsignals.org) # search = may index and link to pages in search results # ai-input = may NOT feed pages into AI answers # ai-train = may NOT train AI models Content-Signal: search=yes, ai-input=no, ai-train=no # 1. SEARCH INDEXERS: allowed, so the site appears in search results # (Google, Bing/Copilot, Apple, DuckDuckGo, ChatGPT search, Claude search, # Perplexity search listings). User-agent: Googlebot User-agent: Googlebot-Image User-agent: Bingbot User-agent: Applebot User-agent: DuckDuckBot User-agent: OAI-SearchBot User-agent: Claude-SearchBot User-agent: PerplexityBot Allow: / # 2. AI TRAINING CRAWLERS: blocked. Blocking Google-Extended does NOT # affect Google Search ranking or visibility. User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: Google-Extended User-agent: Google-CloudVertexBot User-agent: Applebot-Extended User-agent: CCBot User-agent: Bytespider User-agent: Meta-ExternalAgent User-agent: FacebookBot User-agent: Amazonbot User-agent: cohere-ai User-agent: cohere-training-data-crawler User-agent: Diffbot User-agent: AI2Bot User-agent: Ai2Bot-Dolma User-agent: Omgilibot User-agent: Timpibot User-agent: ImagesiftBot User-agent: Kangaroo Bot User-agent: TikTokSpider User-agent: PetalBot User-agent: YouBot Disallow: / # 3. AI ASSISTANTS FETCHING ON REQUEST: blocked. These visit a page when a # user pastes the link and asks the AI to read or summarise it. User-agent: ChatGPT-User User-agent: Claude-User User-agent: Perplexity-User User-agent: MistralAI-User User-agent: Meta-ExternalFetcher User-agent: Gemini-Deep-Research User-agent: GoogleAgent-Mariner User-agent: DuckAssistBot Disallow: / # Everyone else (ordinary search engines and browsers) User-agent: * Allow: / Sitemap: https://www.agrinoteskau.com/sitemap.xml