# robots.txt for http://www.astre471.org/ User-agent: inktomisearch Disallow: / User-agent: Slurp Crawl-delay: 600 User-agent: * Disallow: /minutes