# Aggressive / AI scraper crawlers — also hard-blocked at the app layer # (taboola-guard.php). Listed here for the ones that honor robots.txt. User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Amazonbot Disallow: / User-agent: Bytespider Disallow: / User-agent: PetalBot Disallow: / User-agent: Baiduspider Disallow: / # Everyone else (Googlebot, Bingbot, AhrefsBot, …): allowed, but be gentle. User-agent: * Crawl-delay: 10 Disallow: /wp-admin/ Disallow: /wp-login.php Allow: /wp-admin/admin-ajax.php Sitemap: https://www.skimlinks.com/sitemap_index.xml