# robots.txt for http://theether.net/ User-Agent: stress-agent Disallow: / User-Agent: msnbot Crawl-Delay: 300 User-Agent: libwww-perl Disallow: / User-Agent: * Disallow: /admin Disallow: /awstats Disallow: /cgi-bin Disallow: /tmp Disallow: /*view=