User-agent: * Disallow: /ajax/ User-Agent: MJ12bot Crawl-Delay: 20 User-agent: DataForSeoBot Crawl-delay: 20 User-agent: SeekportBot Crawl-delay: 20 Sitemap: https://www.ukmalls.co.uk/Sitemap_index.xml