# For domain: http://www.wellrated.co.uk # All robots will spider the domain User-agent: * Allow: / Disallow: /content/link-to/ Disallow: /adverts/ Disallow: /twatch/ Disallow: /content/online-shopping-news/