User-agent: * Crawl-delay: 10 Disallow: /dev/ Disallow: /test/ Disallow: /stats/ Disallow: /usage/ Disallow: /logs/ Disallow: /tmp/ Disallow: /back-site/