Crawl-delay: 30 Sitemap: https://speechandlanguage.org.uk/wp-sitemap.xml User-agent: Amazonbot Disallow: / User-agent: googlebot Disallow: User-agent: bingbot Disallow: User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php # Block aggressive AI crawlers User-agent: BLEXBot Disallow: / User-agent: barkrowler Disallow: / User-agent: SEBot-WA Disallow: /