User-agent: * # directed to all spiders, not just Scooter Disallow: /cgi-bin/ Disallow: /logs Disallow: /mightyit Disallow: /database Disallow: /files Disallow: /out Disallow: /scr