User-agent: * Disallow: /test/ User-agent: googlebot-news Disallow: / Disallow: /magazine/*/thema/ Allow: /magazine/ Allow: /amp/ Allow: /$ User-agent: AI2Bot User-agent: Ai2Bot User-agent: Amazonbot User-agent: Applebot-Extended User-agent: CCBot User-agent: Cincraw User-agent: ClaudeBot User-agent: cohere-ai User-agent: Diffbot User-agent: FriendlyCrawler User-agent: GPTBot User-agent: ImagesiftBot User-agent: img2dataset User-agent: Meta-ExternalAgent User-agent: PetalBot User-agent: Semanticbot User-agent: TimpiBot User-agent: VelenPublicWebCrawler User-agent: Yandex Disallow: /magazine/ Allow: /magazine/in-eigener-sache/ Allow: /magazine/unicef/ Allow: /magazine/so-arbeitet-die-redaktion/